Jul 09 08:52:38 devstack cinder-volume[75320]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 09 08:52:38 devstack cinder-volume[75320]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 09 08:52:38 devstack cinder-volume[75320]: we strongly recommend against using it for new projects.
Jul 09 08:52:38 devstack cinder-volume[75320]: If you are already using Eventlet, we recommend migrating to a different
Jul 09 08:52:38 devstack cinder-volume[75320]: framework.  For more detail see
Jul 09 08:52:38 devstack cinder-volume[75320]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 09 08:52:38 devstack cinder-volume[75320]:   import eventlet  # noqa
Jul 09 08:52:40 devstack cinder-volume[75320]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 09 08:52:40 devstack cinder-volume[75320]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 09 08:52:40 devstack cinder-volume[75320]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 09 08:52:41 devstack cinder-volume[75320]: INFO dbcounter [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Registered counter for database cinder
Jul 09 08:52:41 devstack cinder-volume[75320]: DEBUG oslo_db.sqlalchemy.engines [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 08:52:41 devstack cinder-volume[75320]: DEBUG dbcounter [-] [75320] Writer thread running {{(pid=75320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 09 08:52:41 devstack cinder-volume[75320]: INFO cinder.rpc [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 09 08:52:41 devstack cinder-volume[75320]: INFO cinder.rpc [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 09 08:52:41 devstack cinder-volume[75320]: DEBUG oslo_db.sqlalchemy.engines [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 08:52:41 devstack cinder-volume[75320]: INFO cinder.volume.manager [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Determined volume DB was empty at startup.
Jul 09 08:52:41 devstack cinder-volume[75320]: DEBUG cinder.volume.manager [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75320) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 09 08:52:41 devstack cinder-volume[75320]: INFO cinder.volume.manager [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 09 08:52:41 devstack cinder-volume[75320]: WARNING stevedore.named [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 09 08:52:41 devstack cinder-volume[75320]: WARNING castellan.key_manager [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 09 08:52:41 devstack cinder-volume[75320]: WARNING cinder.keymgr.conf_key_mgr [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 09 08:52:41 devstack cinder-volume[75320]: DEBUG cinder.volume.drivers.lvm [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75320) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 09 08:52:41 devstack cinder-volume[75320]: DEBUG oslo_concurrency.processutils [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_concurrency.processutils [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.394s {{(pid=75320) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_db.sqlalchemy.engines [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 08:52:42 devstack cinder-volume[75320]: INFO cinder.rpc [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 09 08:52:42 devstack cinder-volume[75320]: INFO cinder.rpc [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 09 08:52:42 devstack cinder-volume[75320]: WARNING stevedore.named [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 09 08:52:42 devstack cinder-volume[75320]: WARNING castellan.key_manager [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 09 08:52:42 devstack cinder-volume[75320]: INFO cinder.volume.manager [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_db.sqlalchemy.engines [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75320) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 08:52:42 devstack cinder-volume[75320]: INFO oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Starting 1 workers
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Started child 75497 {{(pid=75320) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Full set of CONF: {{(pid=75320) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] ******************************************************************************** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Configuration options gathered from: {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] ================================================================================ {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] allow_availability_zone_fallback = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] allow_compression_on_image_upload = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] allowed_direct_url_schemes     = [] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] api_rate_limit                 = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] auth_strategy                  = keystone {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] az_cache_duration              = 3600 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75497]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_availability_zone      = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_host                   = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_name                   = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_stats_polling_interval = 60 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backup_api_class               = cinder.backup.api.API {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backup_name_template           = backup-%s {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backup_use_same_host           = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backup_use_temp_snapshot       = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] chap_password                  = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] chap_username                  =  {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cinder_internal_tenant_project_id = 79356c3cc0214b7fa8eafad1e2e774a7 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cinder_internal_tenant_user_id = 736217e212304343bcd9365494d11010 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cloned_volume_same_az          = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cluster                        = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] compression_format             = gzip {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] config_dir                     = [] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] config_source                  = [] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] control_exchange               = openstack {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] debug                          = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] default_availability_zone      = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] default_group_type             = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] default_volume_type            = lvmdriver-1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] disk_geometry                  = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] driver_client_cert             = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] driver_client_cert_key         = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] driver_data_namespace          = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] driver_ssl_cert_path           = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] driver_ssl_cert_verify         = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] driver_use_ssl                 = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] enable_force_upload            = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] enable_new_services            = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] enable_unsupported_driver      = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] enforce_multipath_for_image_xfer = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] filter_function                = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance_api_insecure            = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance_api_servers             = ['http://192.168.122.65/image'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance_api_ssl_compression     = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance_ca_certificates_file    = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance_certfile                = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance_keyfile                 = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance_num_retries             = 3 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance_request_timeout         = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] goodness_function              = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] graceful_shutdown_timeout      = 5 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] group_api_class                = cinder.group.api.API {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] host                           = devstack {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] image_compress_on_upload       = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] image_conversion_address_space_limit = 1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] image_conversion_cpu_limit     = 60 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] image_conversion_disable       = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] image_upload_use_cinder_backend = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] image_upload_use_internal_tenant = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] image_volume_cache_enabled     = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] image_volume_cache_max_count   = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] image_volume_cache_max_size_gb = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] init_host_max_objects_retrieval = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] iscsi_target_flags             =  {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] iscsi_write_cache              = on {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] iser_helper                    = tgtadm {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] iser_ip_address                = 192.168.122.65 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] iser_port                      = 3260 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] log_color                      = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] log_config_append              = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] log_dir                        = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] log_file                       = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] log_options                    = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] log_rotate_interval            = 1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] log_rotate_interval_type       = days {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] log_rotation_type              = none {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack sudo[75502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] max_age                        = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] max_logfile_count              = 30 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] max_logfile_size_mb            = 200 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] max_over_subscription_ratio    = 20.0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] message_reap_interval          = 86400 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] message_ttl                    = 2592000 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] migration_create_volume_timeout_secs = 300 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack sudo[75502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] monkey_patch                   = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] monkey_patch_modules           = [] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] my_ip                          = 192.168.122.65 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] no_snapshot_gb_quota           = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] num_iser_scan_tries            = 3 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] num_shell_tries                = 3 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] num_volume_device_scan_tries   = 3 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] nvmeof_conn_info_version       = 1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] nvmet_ns_id                    = 10 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] nvmet_port_id                  = 1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] osapi_max_limit                = 1000 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] osapi_volume_ext_list          = [] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] osapi_volume_listen_port       = 8776 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] osapi_volume_use_ssl           = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] osapi_volume_workers           = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] per_volume_size_limit          = -1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] periodic_fuzzy_delay           = 60 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] periodic_interval              = 60 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] public_endpoint                = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] publish_errors                 = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] quota_backup_gigabytes         = 1000 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] quota_backups                  = 10 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] quota_gigabytes                = 1000 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] quota_groups                   = 10 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] quota_snapshots                = 10 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] quota_volumes                  = 10 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] rate_limit_burst               = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] rate_limit_except_level        = CRITICAL {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] rate_limit_interval            = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] reinit_driver_count            = 3 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] replication_device             = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] report_discard_supported       = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75497]: INFO cinder.volume.manager [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] report_interval                = 120 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] reservation_clean_interval     = 86400 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] reservation_expire             = 86400 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] reserved_image_namespaces      = [] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:42 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] reserved_percentage            = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] rpc_response_timeout           = 120 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] run_external_periodic_tasks    = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] scst_target_driver             = iscsi {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] scst_target_iqn_name           = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] service_down_time              = 720 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] shell_completion               = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] snapshot_name_template         = snapshot-%s {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] snapshot_same_host             = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] split_loggers                  = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] state_path                     = /opt/stack/data/cinder {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] storage_availability_zone      = nova {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] storage_protocol               = iSCSI {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] syslog_log_facility            = LOG_USER {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] target_helper                  = lioadm {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] target_ip_address              = 192.168.122.65 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] target_port                    = 3260 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] target_protocol                = iscsi {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] target_secondary_ip_addresses  = [] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] trace_flags                    = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] transport_url                  = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] until_refresh                  = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] use_chap_auth                  = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] use_default_quota_class        = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] use_journal                    = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] use_json                       = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] use_multipath_for_image_xfer   = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] use_stderr                     = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] use_syslog                     = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] verify_glance_signatures       = enabled {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] volume_api_class               = cinder.volume.api.API {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] volume_backend_name            = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] volume_clear                   = zero {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] volume_clear_ionice            = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] volume_clear_size              = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] volume_copy_bps_limit          = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] volume_dd_blocksize            = 1M {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] volume_name_template           = volume-%s {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] volume_service_inithost_offload = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] volume_usage_audit_period      = month {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] zoning_mode                    = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_concurrency.disable_process_locking = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.auth_section = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.auth_type   = password {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.auth_version = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.cache       = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.certfile    = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.include_service_catalog = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.insecure    = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.interface   = public {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.keyfile     = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_password =  {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcache_username =  {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.059s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.region_name = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.service_type = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.65/identity {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.backend                  = dogpile.cache.null {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.backend_argument         = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.backend_expiration_time  = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.config_prefix            = cache.oslo {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.debug_cache_backend      = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.enable_retry_client      = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.enable_socket_keepalive  = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.enabled                  = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.expiration_time          = 600 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.hashclient_retry_attempts = 2 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.memcache_dead_retry      = 300 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.memcache_sasl_enabled    = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.password                 = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.proxies                  = [] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.redis_db                 = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.redis_server             = localhost:6379 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.retry_attempts           = 2 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.retry_delay              = 0.0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.socket_keepalive_count   = 1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.socket_keepalive_idle    = 1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.socket_keepalive_interval = 1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.socket_timeout           = 1.0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.tls_allowed_ciphers      = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.tls_cafile               = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.tls_certfile             = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.tls_enabled              = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.tls_keyfile              = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cache.username                 = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] coordination.backend_url       = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.asyncio_connection    = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.asyncio_slave_connection = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.backend               = sqlalchemy {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.connection            = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.connection_debug      = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.connection_parameters =  {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.connection_recycle_time = 3600 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.connection_trace      = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.db_inc_retry_interval = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.db_max_retries        = 20 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.db_max_retry_interval = 10 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.db_retry_interval     = 1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.max_overflow          = 50 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.max_pool_size         = 5 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.max_retries           = 10 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.mysql_wsrep_sync_wait = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.pool_timeout          = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.retry_interval        = 10 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.slave_connection      = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.sqlite_synchronous    = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.synchronous_reader    = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] database.use_db_reconnect      = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] profiler.connection_string     = messaging:// {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] profiler.enabled               = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] profiler.es_doc_type           = notification {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] profiler.es_scroll_size        = 10000 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] profiler.es_scroll_time        = 2m {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] profiler.filter_error_trace    = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] profiler.hmac_keys             = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] profiler.sentinel_service_name = mymaster {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] profiler.socket_timeout        = 0.1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] profiler.trace_requests        = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] profiler.trace_sqlalchemy      = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] profiler_jaeger.process_tags   = {} {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] profiler_jaeger.service_name_prefix = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] profiler_otlp.service_name_prefix = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_policy.enforce_new_defaults = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_policy.enforce_scope      = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_policy.policy_default_rule = default {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] privsep_osbrick.group          = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] privsep_osbrick.helper_command = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] privsep_osbrick.user           = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cinder_sys_admin.group         = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cinder_sys_admin.helper_command = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] cinder_sys_admin.user          = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] service_user.auth_section      = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] service_user.auth_type         = password {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] service_user.cafile            = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] service_user.certfile          = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] service_user.collect_timing    = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] service_user.insecure          = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] service_user.keyfile           = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] service_user.send_service_user_token = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] service_user.split_loggers     = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] service_user.timeout           = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance.auth_section            = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance.auth_type               = password {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance.certfile                = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance.collect_timing          = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance.insecure                = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance.keyfile                 = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance.region_name             = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance.split_loggers           = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] glance.timeout                 = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.backend_availability_zone = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.chap_password = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.chap_username =  {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.disk_geometry = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.driver_client_cert = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.driver_client_cert_key = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.driver_data_namespace = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.driver_use_ssl = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.extra_capabilities = {} {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.filter_function = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.goodness_function = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.iscsi_target_flags =  {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.iscsi_write_cache = on {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.iser_ip_address = 192.168.122.65 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.iser_port     = 3260 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.lvm_share_target = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.lvm_type      = auto {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.num_shell_tries = 3 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.replication_device = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.report_discard_supported = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.reserved_percentage = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.target_helper = tgtadm {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.target_ip_address = 192.168.122.65 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.target_port   = 3260 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.target_protocol = iscsi {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.trace_flags   = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.unique_fqdn_network = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.use_chap_auth = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.volume_backend_name = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.volume_clear  = zero {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.volume_clear_ionice = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.volume_clear_size = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_reports.file_event_handler = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_reports.log_dir           = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.backend_host       = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.chap_password      = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.chap_username      = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.disk_geometry      = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.driver_client_cert = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.extra_capabilities = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.filter_function    = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.goodness_function  = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.iser_helper        = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.iser_port          = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.lvm_type           = auto {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.replication_device = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.report_discard_supported = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.reserved_percentage = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.scst_target_driver = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.storage_protocol   = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.target_ip_address  = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.target_port        = 3260 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.trace_flags        = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.volume_clear       = zero {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] lvmdriver-1.volumes_dir        = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_notifications.driver = [] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_notifications.retry = -1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] key_manager.fixed_key          = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.barbican_api_version  = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.barbican_endpoint     = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.barbican_endpoint_type = public {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.barbican_region_name  = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.cafile                = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.certfile              = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.collect_timing        = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.insecure              = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.keyfile               = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.number_of_retries     = 60 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.retry_delay           = 1 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.send_service_user_token = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.split_loggers         = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.timeout               = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.verify_ssl            = True {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican.verify_ssl_path       = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican_service_user.auth_section = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican_service_user.auth_type = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican_service_user.cafile   = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican_service_user.certfile = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican_service_user.collect_timing = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican_service_user.insecure = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican_service_user.keyfile  = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican_service_user.split_loggers = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] barbican_service_user.timeout  = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] vault.approle_role_id          = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] vault.approle_secret_id        = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] vault.kv_mountpoint            = secret {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] vault.kv_path                  = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] vault.kv_version               = 2 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] vault.namespace                = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] vault.root_token_id            = **** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] vault.ssl_ca_crt_file          = None {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] vault.timeout                  = 60.0 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] vault.use_ssl                  = False {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:52:43 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] ******************************************************************************** {{(pid=75320) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 09 08:52:43 devstack sudo[75502]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:43 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.842s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:43 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:43 devstack sudo[75646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 08:52:43 devstack sudo[75646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:44 devstack sudo[75646]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:44 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.645s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:44 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 08:52:44 devstack cinder-volume[75497]: INFO cinder.brick.local_dev.lvm [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 09 08:52:44 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:44 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:44 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:44 devstack sudo[75855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 08:52:44 devstack sudo[75855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:44 devstack sudo[75855]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:45 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:45 devstack cinder-volume[75497]: DEBUG cinder.brick.local_dev.lvm [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75497) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 09 08:52:45 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:45 devstack sudo[76064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 08:52:45 devstack sudo[76064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:46 devstack sudo[76064]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:46 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.165s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:46 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:46 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:46 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:46 devstack sudo[76275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 08:52:46 devstack sudo[76275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:46 devstack sudo[76275]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:46 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.691s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:46 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:46 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:46 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:46 devstack sudo[76280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 09 08:52:46 devstack sudo[76280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:47 devstack sudo[76280]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:47 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.680s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:47 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:47 devstack sudo[76284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 08:52:47 devstack sudo[76284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:48 devstack sudo[76284]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:48 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:48 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:48 devstack sudo[76291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 08:52:48 devstack sudo[76291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:49 devstack sudo[76291]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:49 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.838s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:49 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:49 devstack sudo[76302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:52:49 devstack sudo[76302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:49 devstack sudo[76302]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:49 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:49 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:49 devstack sudo[76307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 08:52:49 devstack sudo[76307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:50 devstack sudo[76307]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:50 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.846s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:50 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:50 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:50 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:50 devstack sudo[76313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 08:52:50 devstack sudo[76313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:51 devstack sudo[76313]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:51 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.903s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:51 devstack cinder-volume[75497]: INFO cinder.volume.drivers.lvm [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 09 08:52:51 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:51 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:51 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:51 devstack sudo[76435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 08:52:51 devstack sudo[76435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:52 devstack sudo[76435]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:52 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:52 devstack cinder-volume[75497]: DEBUG cinder.volume.drivers.lvm [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Updating volume stats {{(pid=75497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 09 08:52:52 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:52 devstack sudo[76440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 08:52:52 devstack sudo[76440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:52 devstack cinder-volume[75320]: DEBUG dbcounter [-] [75320] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75320) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 08:52:52 devstack sudo[76440]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:52 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:52 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:52 devstack sudo[76584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:52:52 devstack sudo[76584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:53 devstack sudo[76584]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:53 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:53 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:53 devstack sudo[76588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 08:52:53 devstack sudo[76588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:54 devstack sudo[76588]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:54 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.631s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:54 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:54 devstack sudo[76591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:52:54 devstack sudo[76591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:54 devstack sudo[76591]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:54 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:54 devstack cinder-volume[75497]: INFO cinder.volume.driver [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Driver hasn't implemented _init_vendor_properties()
Jul 09 08:52:54 devstack cinder-volume[75497]: DEBUG cinder.volume.driver [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75497) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 09 08:52:54 devstack cinder-volume[75497]: DEBUG oslo_db.sqlalchemy.engines [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75497) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 08:52:54 devstack cinder-volume[75497]: DEBUG dbcounter [-] [75497] Writer thread running {{(pid=75497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 09 08:52:54 devstack cinder-volume[75497]: DEBUG cinder.db.api [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Building query based on filter {{(pid=75497) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 09 08:52:54 devstack cinder-volume[75497]: DEBUG cinder.image.image_utils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75497) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 09 08:52:54 devstack cinder-volume[75497]: INFO cinder.keymgr.migration [None req-e087bd7f-a743-40d2-91fa-ebb5355d1f10 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 09 08:52:54 devstack cinder-volume[75497]: DEBUG cinder.volume.drivers.lvm [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Updating volume stats {{(pid=75497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 09 08:52:54 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:54 devstack sudo[76596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 08:52:54 devstack sudo[76596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:55 devstack sudo[76596]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:55 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:55 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:55 devstack sudo[76599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:52:55 devstack sudo[76599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:56 devstack sudo[76599]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:56 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:56 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:56 devstack sudo[76606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 08:52:56 devstack sudo[76606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:56 devstack sudo[76606]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:56 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:56 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:56 devstack sudo[76609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:52:56 devstack sudo[76609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:57 devstack sudo[76609]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:57 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.695s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:57 devstack cinder-volume[75497]: DEBUG cinder.manager [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Notifying Schedulers of capabilities ... {{(pid=75497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:52:57 devstack cinder-volume[75497]: INFO cinder.volume.manager [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Driver initialization completed successfully.
Jul 09 08:52:57 devstack cinder-volume[75497]: INFO cinder.manager [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Initiating service 2 cleanup
Jul 09 08:52:57 devstack cinder-volume[75497]: INFO cinder.manager [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Service 2 cleanup completed.
Jul 09 08:52:57 devstack cinder-volume[75497]: DEBUG cinder.service [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Creating RPC server for service cinder-volume {{(pid=75497) start /opt/stack/cinder/cinder/service.py:231}}
Jul 09 08:52:57 devstack cinder-volume[75497]: DEBUG cinder.service [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75497) start /opt/stack/cinder/cinder/service.py:237}}
Jul 09 08:52:57 devstack cinder-volume[75497]: INFO cinder.volume.manager [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 09 08:52:57 devstack cinder-volume[75497]: DEBUG cinder.volume.drivers.lvm [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Updating volume stats {{(pid=75497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 09 08:52:57 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:57 devstack sudo[76613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 08:52:57 devstack sudo[76613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:58 devstack sudo[76613]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:58 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:58 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:58 devstack sudo[76618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:52:58 devstack sudo[76618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:58 devstack sudo[76618]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:58 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:58 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:58 devstack sudo[76621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 08:52:59 devstack sudo[76621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:52:59 devstack sudo[76621]: pam_unix(sudo:session): session closed for user root
Jul 09 08:52:59 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:52:59 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:52:59 devstack sudo[76678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:52:59 devstack sudo[76678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:53:00 devstack sudo[76678]: pam_unix(sudo:session): session closed for user root
Jul 09 08:53:00 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:53:00 devstack cinder-volume[75497]: INFO cinder.volume.manager [None req-6a113544-3ddb-4def-b6df-656e2ac9ef74 None None] Driver post RPC initialization completed successfully.
Jul 09 08:53:10 devstack cinder-volume[75497]: DEBUG dbcounter [-] [75497] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 08:53:10 devstack cinder-volume[75497]: DEBUG dbcounter [-] [75497] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 08:53:55 devstack cinder-volume[75497]: DEBUG oslo_service.periodic_task [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 08:53:55 devstack cinder-volume[75497]: DEBUG cinder.volume.drivers.lvm [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Updating volume stats {{(pid=75497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 09 08:53:55 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:53:55 devstack sudo[78368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 08:53:55 devstack sudo[78368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:53:55 devstack sudo[78368]: pam_unix(sudo:session): session closed for user root
Jul 09 08:53:55 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:53:55 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:53:55 devstack sudo[78371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:53:55 devstack sudo[78371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:53:56 devstack sudo[78371]: pam_unix(sudo:session): session closed for user root
Jul 09 08:53:56 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:53:56 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:53:56 devstack sudo[78374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 08:53:56 devstack sudo[78374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:53:57 devstack sudo[78374]: pam_unix(sudo:session): session closed for user root
Jul 09 08:53:57 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.654s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:53:57 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:53:57 devstack sudo[78395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:53:57 devstack sudo[78395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:53:57 devstack sudo[78395]: pam_unix(sudo:session): session closed for user root
Jul 09 08:53:57 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:53:57 devstack cinder-volume[75497]: DEBUG cinder.manager [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Notifying Schedulers of capabilities ... {{(pid=75497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:53:57 devstack cinder-volume[75497]: DEBUG oslo_service.periodic_task [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running periodic task VolumeManager._thread_info {{(pid=75497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 08:53:57 devstack cinder-volume[75497]: DEBUG cinder.volume.manager [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] thread count: 6 {{(pid=75497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 08:53:57 devstack cinder-volume[75497]: DEBUG cinder.volume.manager [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] thread info: [<_MainThread(MainThread, started 130854529544320)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130854418025152)>, <Thread(Thread-3 (stat_writer), started daemon 130854417852864)>, <Thread(Rabbit-heartbeat, started daemon 130854417385792)>, <Thread(Thread-5 (_runner), started daemon 130854417533696)>, <Thread(Thread-7 (_runner), started daemon 130854415536768)>] {{(pid=75497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 08:54:55 devstack cinder-volume[75497]: DEBUG oslo_service.periodic_task [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 08:54:55 devstack cinder-volume[75497]: DEBUG cinder.volume.drivers.lvm [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Updating volume stats {{(pid=75497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 09 08:54:55 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:54:55 devstack sudo[81655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 08:54:55 devstack sudo[81655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:54:55 devstack sudo[81655]: pam_unix(sudo:session): session closed for user root
Jul 09 08:54:55 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:54:55 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:54:55 devstack sudo[81659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:54:55 devstack sudo[81659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:54:56 devstack sudo[81659]: pam_unix(sudo:session): session closed for user root
Jul 09 08:54:56 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:54:56 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:54:56 devstack sudo[81672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 08:54:56 devstack sudo[81672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:54:57 devstack sudo[81672]: pam_unix(sudo:session): session closed for user root
Jul 09 08:54:57 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:54:57 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:54:57 devstack sudo[81685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:54:57 devstack sudo[81685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:54:57 devstack sudo[81685]: pam_unix(sudo:session): session closed for user root
Jul 09 08:54:57 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:54:57 devstack cinder-volume[75497]: DEBUG cinder.manager [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Notifying Schedulers of capabilities ... {{(pid=75497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:55:10 devstack cinder-volume[75497]: DEBUG dbcounter [-] [75497] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 08:55:55 devstack cinder-volume[75497]: DEBUG oslo_service.periodic_task [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 08:55:55 devstack cinder-volume[75497]: DEBUG cinder.volume.drivers.lvm [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Updating volume stats {{(pid=75497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 09 08:55:55 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:55:55 devstack sudo[84061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 08:55:55 devstack sudo[84061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:55:55 devstack sudo[84061]: pam_unix(sudo:session): session closed for user root
Jul 09 08:55:55 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:55:55 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:55:55 devstack sudo[84088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:55:55 devstack sudo[84088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:55:56 devstack sudo[84088]: pam_unix(sudo:session): session closed for user root
Jul 09 08:55:56 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:55:56 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:55:56 devstack sudo[84108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 08:55:56 devstack sudo[84108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:55:57 devstack sudo[84108]: pam_unix(sudo:session): session closed for user root
Jul 09 08:55:57 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.685s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:55:57 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:55:57 devstack sudo[84134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:55:57 devstack sudo[84134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:55:57 devstack sudo[84134]: pam_unix(sudo:session): session closed for user root
Jul 09 08:55:57 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:55:57 devstack cinder-volume[75497]: DEBUG cinder.manager [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Notifying Schedulers of capabilities ... {{(pid=75497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:55:57 devstack cinder-volume[75497]: DEBUG oslo_service.periodic_task [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running periodic task VolumeManager._thread_info {{(pid=75497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 08:55:57 devstack cinder-volume[75497]: DEBUG cinder.volume.manager [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] thread count: 6 {{(pid=75497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 08:55:57 devstack cinder-volume[75497]: DEBUG cinder.volume.manager [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] thread info: [<_MainThread(MainThread, started 130854529544320)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130854418025152)>, <Thread(Thread-3 (stat_writer), started daemon 130854417852864)>, <Thread(Rabbit-heartbeat, started daemon 130854417385792)>, <Thread(Thread-5 (_runner), started daemon 130854417533696)>, <Thread(Thread-7 (_runner), started daemon 130854415536768)>] {{(pid=75497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 08:56:55 devstack cinder-volume[75497]: DEBUG oslo_service.periodic_task [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 08:56:55 devstack cinder-volume[75497]: DEBUG cinder.volume.drivers.lvm [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Updating volume stats {{(pid=75497) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 09 08:56:55 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:56:55 devstack sudo[85406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 09 08:56:55 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:56:55 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root
Jul 09 08:56:55 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:56:55 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:56:56 devstack sudo[85410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:56:56 devstack sudo[85410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:56:56 devstack sudo[85410]: pam_unix(sudo:session): session closed for user root
Jul 09 08:56:56 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:56:56 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:56:56 devstack sudo[85416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 09 08:56:56 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:56:57 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root
Jul 09 08:56:57 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:56:57 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:56:57 devstack sudo[85425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 09 08:56:57 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:56:57 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root
Jul 09 08:56:57 devstack cinder-volume[75497]: DEBUG oslo_concurrency.processutils [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=75497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:56:57 devstack cinder-volume[75497]: DEBUG cinder.manager [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Notifying Schedulers of capabilities ... {{(pid=75497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:56:57 devstack cinder-volume[75497]: DEBUG oslo_service.periodic_task [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] Running periodic task VolumeManager._thread_info {{(pid=75497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 08:56:57 devstack cinder-volume[75497]: DEBUG cinder.volume.manager [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] thread count: 6 {{(pid=75497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 08:56:57 devstack cinder-volume[75497]: DEBUG cinder.volume.manager [None req-0a0c15de-59f8-429c-bd3c-4de787deecc5 None None] thread info: [<_MainThread(MainThread, started 130854529544320)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130854418025152)>, <Thread(Thread-3 (stat_writer), started daemon 130854417852864)>, <Thread(Rabbit-heartbeat, started daemon 130854417385792)>, <Thread(Thread-5 (_runner), started daemon 130854417533696)>, <Thread(Thread-7 (_runner), started daemon 130854415536768)>] {{(pid=75497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 08:57:10 devstack cinder-volume[75497]: DEBUG dbcounter [-] [75497] Writing DB stats cinder:SELECT=1 {{(pid=75497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 08:57:10 devstack cinder-volume[75497]: DEBUG dbcounter [-] [75497] Writing DB stats cinder:UPDATE=1 {{(pid=75497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 08:57:21 devstack cinder-volume[75320]: INFO oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Caught SIGTERM, stopping children
Jul 09 08:57:21 devstack cinder-volume[75320]: DEBUG oslo_concurrency.lockutils [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Acquiring lock "singleton_lock" {{(pid=75320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 09 08:57:21 devstack cinder-volume[75320]: DEBUG oslo_concurrency.lockutils [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Acquired lock "singleton_lock" {{(pid=75320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 09 08:57:21 devstack cinder-volume[75320]: DEBUG oslo_concurrency.lockutils [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Releasing lock "singleton_lock" {{(pid=75320) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 09 08:57:21 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Stop services. {{(pid=75320) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 09 08:57:21 devstack cinder-volume[75320]: DEBUG oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Killing children. {{(pid=75320) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 09 08:57:21 devstack cinder-volume[75320]: INFO oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Waiting on 1 children to exit
Jul 09 08:57:22 devstack cinder-volume[75497]: DEBUG oslo_concurrency.lockutils [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Acquiring lock "singleton_lock" {{(pid=75497) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 09 08:57:22 devstack cinder-volume[75497]: DEBUG oslo_concurrency.lockutils [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Acquired lock "singleton_lock" {{(pid=75497) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 09 08:57:22 devstack cinder-volume[75497]: DEBUG oslo_concurrency.lockutils [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Releasing lock "singleton_lock" {{(pid=75497) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 09 08:57:22 devstack cinder-volume[75497]: WARNING amqp [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 09 08:57:22 devstack cinder-volume[75497]: WARNING amqp [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 09 08:57:22 devstack cinder-volume[75320]: INFO oslo_service.backend._eventlet.service [None req-27f42685-1a1a-4181-b3f6-ebccd60a84b1 None None] Child 75497 exited with status 0
Jul 09 08:57:23 devstack cinder-volume[86046]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 09 08:57:23 devstack cinder-volume[86046]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 09 08:57:23 devstack cinder-volume[86046]: we strongly recommend against using it for new projects.
Jul 09 08:57:23 devstack cinder-volume[86046]: If you are already using Eventlet, we recommend migrating to a different
Jul 09 08:57:23 devstack cinder-volume[86046]: framework.  For more detail see
Jul 09 08:57:23 devstack cinder-volume[86046]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 09 08:57:23 devstack cinder-volume[86046]:   import eventlet  # noqa
Jul 09 08:57:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 09 08:57:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 09 08:57:25 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 09 08:57:25 devstack cinder-volume[86046]: INFO dbcounter [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Registered counter for database cinder
Jul 09 08:57:25 devstack cinder-volume[86046]: DEBUG oslo_db.sqlalchemy.engines [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writer thread running {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 09 08:57:26 devstack cinder-volume[86046]: INFO cinder.rpc [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 09 08:57:26 devstack cinder-volume[86046]: INFO cinder.rpc [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_db.sqlalchemy.engines [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 08:57:26 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Determined volume DB was empty at startup.
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86046) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 09 08:57:26 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 09 08:57:26 devstack cinder-volume[86046]: WARNING stevedore.named [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 09 08:57:26 devstack cinder-volume[86046]: WARNING castellan.key_manager [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 09 08:57:26 devstack cinder-volume[86046]: WARNING cinder.keymgr.conf_key_mgr [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 09 08:57:26 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_db.sqlalchemy.engines [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 08:57:26 devstack cinder-volume[86046]: INFO oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Starting 1 workers
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Started child 86261 {{(pid=86046) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Full set of CONF: {{(pid=86046) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] ******************************************************************************** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Configuration options gathered from: {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] ================================================================================ {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] allow_availability_zone_fallback = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] allow_compression_on_image_upload = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] allowed_direct_url_schemes     = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] api_rate_limit                 = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] auth_strategy                  = keystone {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_availability_zone      = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_host                   = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_name                   = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_stats_polling_interval = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86261]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backup_api_class               = cinder.backup.api.API {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backup_name_template           = backup-%s {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backup_use_same_host           = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backup_use_temp_snapshot       = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] chap_password                  = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] chap_username                  =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cinder_internal_tenant_project_id = 79356c3cc0214b7fa8eafad1e2e774a7 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cinder_internal_tenant_user_id = 736217e212304343bcd9365494d11010 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cluster                        = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] compression_format             = gzip {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] compute_api_class              = cinder.compute.nova.API {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] config_dir                     = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] config_source                  = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] control_exchange               = openstack {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] debug                          = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] default_availability_zone      = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] default_group_type             = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] default_volume_type            = QuobyteHD {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] disk_geometry                  = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] driver_client_cert             = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] driver_client_cert_key         = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] driver_data_namespace          = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] driver_ssl_cert_path           = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] driver_ssl_cert_verify         = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] driver_use_ssl                 = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] enable_new_services            = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] enable_unsupported_driver      = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] enabled_backends               = ['QuobyteHD'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] enforce_multipath_for_image_xfer = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] filter_function                = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance_api_insecure            = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance_api_servers             = ['http://192.168.122.65/image'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance_api_ssl_compression     = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance_ca_certificates_file    = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance_catalog_info            = image:glance:publicURL {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance_certfile                = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance_keyfile                 = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance_num_retries             = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance_request_timeout         = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] goodness_function              = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] graceful_shutdown_timeout      = 5 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] group_api_class                = cinder.group.api.API {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] host                           = devstack {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] image_compress_on_upload       = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] image_conversion_address_space_limit = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] image_conversion_cpu_limit     = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] image_conversion_disable       = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] image_upload_use_cinder_backend = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] image_upload_use_internal_tenant = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] image_volume_cache_enabled     = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] image_volume_cache_max_count   = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] image_volume_cache_max_size_gb = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] init_host_max_objects_retrieval = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] instance_format                = [instance: %(uuid)s]  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] iscsi_target_flags             =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] iscsi_write_cache              = on {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] iser_helper                    = tgtadm {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] iser_ip_address                = 192.168.122.65 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] iser_port                      = 3260 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] log_color                      = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] log_config_append              = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] log_dir                        = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] log_file                       = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] log_options                    = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] log_rotate_interval            = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] log_rotate_interval_type       = days {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] log_rotation_type              = none {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] max_age                        = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] max_logfile_count              = 30 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] max_logfile_size_mb            = 200 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] max_over_subscription_ratio    = 20.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] message_reap_interval          = 86400 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] message_ttl                    = 2592000 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] migration_create_volume_timeout_secs = 300 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] monkey_patch                   = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] monkey_patch_modules           = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] my_ip                          = 192.168.122.65 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] no_snapshot_gb_quota           = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] num_iser_scan_tries            = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] num_shell_tries                = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] num_volume_device_scan_tries   = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] nvmeof_conn_info_version       = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] nvmet_ns_id                    = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] nvmet_port_id                  = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] osapi_max_limit                = 1000 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] osapi_volume_ext_list          = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] osapi_volume_listen_port       = 8776 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] osapi_volume_use_ssl           = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] osapi_volume_workers           = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] per_volume_size_limit          = -1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] periodic_fuzzy_delay           = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] periodic_interval              = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] public_endpoint                = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] publish_errors                 = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] quota_backup_gigabytes         = 1000 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] quota_backups                  = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] quota_gigabytes                = 1000 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] quota_groups                   = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] quota_snapshots                = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] quota_volumes                  = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] rate_limit_burst               = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] rate_limit_except_level        = CRITICAL {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] rate_limit_interval            = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] reinit_driver_count            = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] replication_device             = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] report_discard_supported       = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] report_interval                = 120 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] reservation_clean_interval     = 86400 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] reservation_expire             = 86400 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] reserved_image_namespaces      = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] reserved_percentage            = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] rpc_response_timeout           = 120 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] run_external_periodic_tasks    = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] scst_target_driver             = iscsi {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] scst_target_iqn_name           = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] service_down_time              = 720 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] shell_completion               = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] snapshot_name_template         = snapshot-%s {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] split_loggers                  = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] state_path                     = /opt/stack/data/cinder {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] storage_availability_zone      = nova {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] storage_protocol               = iSCSI {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] syslog_log_facility            = LOG_USER {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] target_helper                  = lioadm {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] target_ip_address              = 192.168.122.65 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] target_port                    = 3260 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] target_protocol                = iscsi {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] target_secondary_ip_addresses  = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.remotefs [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86261) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] trace_flags                    = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] transport_url                  = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] until_refresh                  = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] use_chap_auth                  = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] use_default_quota_class        = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] use_journal                    = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] use_json                       = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] use_multipath_for_image_xfer   = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] use_stderr                     = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] use_syslog                     = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] verify_glance_signatures       = enabled {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] volume_api_class               = cinder.volume.api.API {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] volume_backend_name            = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] volume_clear                   = zero {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] volume_clear_ionice            = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] volume_clear_size              = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] volume_copy_bps_limit          = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] volume_dd_blocksize            = 1M {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] volume_name_template           = volume-%s {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] volume_service_inithost_offload = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] volume_usage_audit_period      = month {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] zoning_mode                    = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_concurrency.disable_process_locking = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.auth_section = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.auth_type   = password {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.auth_version = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.cache       = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.certfile    = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.delay_auth_decision = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.http_connect_timeout = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.include_service_catalog = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.insecure    = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.interface   = public {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.keyfile     = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_password =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcache_username =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.region_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.service_token_roles_required = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.service_type = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.token_cache_time = 300 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.65/identity {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.backend                  = dogpile.cache.null {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.backend_argument         = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.backend_expiration_time  = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.config_prefix            = cache.oslo {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.debug_cache_backend      = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.enable_retry_client      = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.enable_socket_keepalive  = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.enabled                  = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.expiration_time          = 600 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.hashclient_retry_attempts = 2 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.memcache_dead_retry      = 300 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.memcache_pool_maxsize    = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.memcache_sasl_enabled    = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.password                 = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.proxies                  = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.redis_db                 = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.redis_sentinel_service_name = mymaster {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.redis_server             = localhost:6379 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.retry_attempts           = 2 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.retry_delay              = 0.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.socket_keepalive_count   = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.socket_keepalive_idle    = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.socket_keepalive_interval = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.socket_timeout           = 1.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.tls_allowed_ciphers      = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.tls_cafile               = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.tls_certfile             = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.tls_enabled              = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.tls_keyfile              = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cache.username                 = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] coordination.backend_url       = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.asyncio_connection    = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.asyncio_slave_connection = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.backend               = sqlalchemy {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.connection            = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.connection_debug      = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.connection_parameters =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.connection_recycle_time = 3600 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.connection_trace      = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.db_inc_retry_interval = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.db_max_retries        = 20 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.db_max_retry_interval = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.db_retry_interval     = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.max_overflow          = 50 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.max_pool_size         = 5 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.max_retries           = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.mysql_wsrep_sync_wait = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.pool_timeout          = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.retry_interval        = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.slave_connection      = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.sqlite_synchronous    = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.synchronous_reader    = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] database.use_db_reconnect      = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] profiler.connection_string     = messaging:// {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] profiler.enabled               = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] profiler.es_doc_type           = notification {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] profiler.es_scroll_size        = 10000 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] profiler.es_scroll_time        = 2m {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] profiler.filter_error_trace    = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] profiler.hmac_keys             = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] profiler.sentinel_service_name = mymaster {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] profiler.socket_timeout        = 0.1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] profiler.trace_requests        = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] profiler.trace_sqlalchemy      = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] profiler_jaeger.process_tags   = {} {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] profiler_jaeger.service_name_prefix = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] profiler_otlp.service_name_prefix = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_policy.enforce_new_defaults = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_policy.enforce_scope      = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_policy.policy_default_rule = default {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_policy.policy_file        = policy.yaml {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] privsep_osbrick.group          = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] privsep_osbrick.helper_command = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] privsep_osbrick.user           = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cinder_sys_admin.group         = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cinder_sys_admin.helper_command = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] cinder_sys_admin.user          = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] service_user.auth_section      = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] service_user.auth_type         = password {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] service_user.cafile            = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] service_user.certfile          = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] service_user.collect_timing    = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] service_user.insecure          = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] service_user.keyfile           = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] service_user.send_service_user_token = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] service_user.split_loggers     = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] service_user.timeout           = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance.auth_section            = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance.auth_type               = password {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance.certfile                = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance.collect_timing          = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance.insecure                = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance.keyfile                 = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance.region_name             = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance.split_loggers           = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] glance.timeout                 = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.backend_availability_zone = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.chap_password = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.chap_username =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.disk_geometry = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.driver_client_cert = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.driver_client_cert_key = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.driver_data_namespace = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.driver_use_ssl = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.enable_unsupported_driver = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.extra_capabilities = {} {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.filter_function = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.goodness_function = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.iscsi_target_flags =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.iscsi_write_cache = on {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.iser_helper   = tgtadm {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.iser_ip_address = 192.168.122.65 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.iser_port     = 3260 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.nas_host      =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.nas_login     = admin {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.nas_mount_options = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.nas_password  = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.nas_private_key =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.nas_share_path =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.num_shell_tries = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.nvmet_port_id = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.quobyte_client_cfg = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.quobyte_volume_url = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.replication_device = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.report_discard_supported = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.reserved_percentage = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.scst_target_driver = iscsi {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.scst_target_iqn_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.storage_protocol = iSCSI {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.target_helper = tgtadm {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.target_ip_address = 192.168.122.65 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.target_port   = 3260 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.target_protocol = iscsi {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.trace_flags   = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.unique_fqdn_network = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.use_chap_auth = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.volume_backend_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.volume_clear  = zero {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.volume_clear_ionice = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.volume_clear_size = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_reports.file_event_handler = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_reports.log_dir           = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.backend_availability_zone = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.backend_host         = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.chap_password        = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.chap_username        = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.chiscsi_conf         = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.disk_geometry        = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.driver_client_cert   = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.driver_client_cert_key = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.driver_data_namespace = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.driver_use_ssl       = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.extra_capabilities   = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.filter_function      = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.goodness_function    = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.iser_helper          = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.iser_ip_address      = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.iser_port            = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.iser_target_prefix   = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.nas_host             = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.nas_login            = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.nas_mount_options    = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.nas_password         = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.nas_private_key      = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.nas_share_path       = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.nas_ssh_port         = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.num_shell_tries      = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.nvmet_port_id        = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.replication_device   = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.report_discard_supported = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.reserved_percentage  = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.scst_target_driver   = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.storage_protocol     = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.target_helper        = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.target_ip_address    = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.target_port          = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.target_prefix        = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.target_protocol      = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.trace_flags          = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.use_chap_auth        = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.volume_clear         = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.volume_clear_size    = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] QuobyteHD.volumes_dir          = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.ssl      = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86261) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 09 08:57:26 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.quobyte [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 09 08:57:26 devstack cinder-volume[86261]: WARNING cinder.volume.drivers.quobyte [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 09 08:57:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Running cmd (subprocess): mount.quobyte {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_notifications.driver = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_notifications.retry = -1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] oslo_messaging_notifications.transport_url = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] key_manager.fixed_key          = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.barbican_api_version  = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.barbican_endpoint     = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.barbican_endpoint_type = public {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.barbican_region_name  = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.cafile                = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.certfile              = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.collect_timing        = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.insecure              = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.keyfile               = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.number_of_retries     = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.retry_delay           = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.send_service_user_token = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.split_loggers         = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.timeout               = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.verify_ssl            = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican.verify_ssl_path       = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican_service_user.auth_section = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican_service_user.auth_type = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican_service_user.cafile   = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican_service_user.certfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican_service_user.collect_timing = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican_service_user.insecure = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican_service_user.keyfile  = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican_service_user.split_loggers = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] barbican_service_user.timeout  = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] vault.approle_role_id          = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] vault.approle_secret_id        = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] vault.kv_mountpoint            = secret {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] vault.kv_path                  = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] vault.kv_version               = 2 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] vault.namespace                = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] vault.root_token_id            = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] vault.ssl_ca_crt_file          = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] vault.timeout                  = 60.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] vault.use_ssl                  = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:26 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] ******************************************************************************** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 09 08:57:26 devstack quobyte-client[86266]: Reading configuration file: /etc/quobyte/client.cfg
Jul 09 08:57:26 devstack quobyte-client[86266]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 09 08:57:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] CMD "mount.quobyte" returned: 1 in 0.096s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:57:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:57:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:57:26 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:57:26 devstack cinder-volume[86261]: INFO cinder.volume.drivers.quobyte [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d ...
Jul 09 08:57:26 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 -c /etc/quobyte/client-cinder.cfg {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:57:27 devstack sudo[86267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 -c /etc/quobyte/client-cinder.cfg
Jul 09 08:57:27 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:57:27 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root
Jul 09 08:57:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.789s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:57:27 devstack cinder-volume[86261]: INFO cinder.volume.drivers.quobyte [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d succeeded
Jul 09 08:57:27 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:57:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.819s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:57:27 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:57:27 devstack sudo[86337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:57:27 devstack sudo[86337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:57:28 devstack sudo[86337]: pam_unix(sudo:session): session closed for user root
Jul 09 08:57:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.616s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:57:28 devstack cinder-volume[86261]: INFO cinder.volume.driver [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Driver hasn't implemented _init_vendor_properties()
Jul 09 08:57:28 devstack cinder-volume[86261]: DEBUG cinder.volume.driver [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86261) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 09 08:57:28 devstack cinder-volume[86261]: DEBUG oslo_db.sqlalchemy.engines [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86261) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 08:57:28 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writer thread running {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 09 08:57:28 devstack cinder-volume[86261]: DEBUG cinder.db.api [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Building query based on filter {{(pid=86261) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 09 08:57:28 devstack cinder-volume[86261]: DEBUG cinder.image.image_utils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86261) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 09 08:57:28 devstack cinder-volume[86261]: INFO cinder.keymgr.migration [None req-d6b36f8d-aed5-4ea6-82b4-6ac4a0a5da86 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 09 08:57:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:57:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:57:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:57:28 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:57:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:57:28 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:57:28 devstack sudo[86341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:57:28 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:57:29 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root
Jul 09 08:57:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.638s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:57:29 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:57:29 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Driver initialization completed successfully.
Jul 09 08:57:29 devstack cinder-volume[86261]: INFO cinder.manager [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Initiating service 3 cleanup
Jul 09 08:57:29 devstack cinder-volume[86261]: INFO cinder.manager [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Service 3 cleanup completed.
Jul 09 08:57:29 devstack cinder-volume[86261]: DEBUG cinder.service [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Creating RPC server for service cinder-volume {{(pid=86261) start /opt/stack/cinder/cinder/service.py:231}}
Jul 09 08:57:29 devstack cinder-volume[86261]: DEBUG cinder.service [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86261) start /opt/stack/cinder/cinder/service.py:237}}
Jul 09 08:57:29 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 09 08:57:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:57:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:57:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:57:29 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:57:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:57:29 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:57:29 devstack sudo[86348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:57:29 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:57:30 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root
Jul 09 08:57:30 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.658s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:57:30 devstack cinder-volume[86261]: INFO cinder.volume.manager [None req-d76d30b6-1317-49dc-be0d-213ca35f4900 None None] Driver post RPC initialization completed successfully.
Jul 09 08:57:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-885bd86b-7e2b-4026-b544-71153628c847 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:57:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-885bd86b-7e2b-4026-b544-71153628c847 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:57:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-885bd86b-7e2b-4026-b544-71153628c847 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=86261) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:57:34 devstack cinder-volume[86261]: DEBUG cinder.volume.drivers.quobyte [None req-885bd86b-7e2b-4026-b544-71153628c847 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=86261) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:57:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-885bd86b-7e2b-4026-b544-71153628c847 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86261) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:57:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-885bd86b-7e2b-4026-b544-71153628c847 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:57:34 devstack sudo[86521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:57:34 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:57:34 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root
Jul 09 08:57:34 devstack cinder-volume[86261]: DEBUG oslo_concurrency.processutils [None req-885bd86b-7e2b-4026-b544-71153628c847 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.602s {{(pid=86261) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:57:34 devstack cinder-volume[86261]: DEBUG cinder.manager [None req-885bd86b-7e2b-4026-b544-71153628c847 None None] Notifying Schedulers of capabilities ... {{(pid=86261) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:57:36 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 08:57:37 devstack cinder-volume[86046]: INFO oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Caught SIGTERM, stopping children
Jul 09 08:57:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Acquiring lock "singleton_lock" {{(pid=86046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 09 08:57:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Acquired lock "singleton_lock" {{(pid=86046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 09 08:57:37 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Releasing lock "singleton_lock" {{(pid=86046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 09 08:57:37 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Stop services. {{(pid=86046) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 09 08:57:37 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Killing children. {{(pid=86046) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 09 08:57:37 devstack cinder-volume[86046]: INFO oslo_service.backend._eventlet.service [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Waiting on 1 children to exit
Jul 09 08:57:39 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=2 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 08:57:40 devstack cinder-volume[86261]: DEBUG dbcounter [-] [86261] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86261) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 08:57:42 devstack cinder-volume[86261]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jul 09 08:57:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Acquiring lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 09 08:57:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Acquired lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 09 08:57:42 devstack cinder-volume[86261]: DEBUG oslo_concurrency.lockutils [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Releasing lock "singleton_lock" {{(pid=86261) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 09 08:57:42 devstack cinder-volume[86261]: WARNING amqp [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 09 08:57:42 devstack cinder-volume[86261]: WARNING amqp [None req-cdae9391-3568-4950-b6e2-c4f05a28abac None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 09 08:57:42 devstack cinder-volume[86748]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 09 08:57:42 devstack cinder-volume[86748]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 09 08:57:42 devstack cinder-volume[86748]: we strongly recommend against using it for new projects.
Jul 09 08:57:42 devstack cinder-volume[86748]: If you are already using Eventlet, we recommend migrating to a different
Jul 09 08:57:42 devstack cinder-volume[86748]: framework.  For more detail see
Jul 09 08:57:42 devstack cinder-volume[86748]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 09 08:57:42 devstack cinder-volume[86748]:   import eventlet  # noqa
Jul 09 08:57:45 devstack cinder-volume[86748]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86748) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 09 08:57:45 devstack cinder-volume[86748]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86748) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 09 08:57:45 devstack cinder-volume[86748]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86748) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 09 08:57:46 devstack cinder-volume[86748]: INFO dbcounter [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] Registered counter for database cinder
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_db.sqlalchemy.engines [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86748) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG dbcounter [-] [86748] Writer thread running {{(pid=86748) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 09 08:57:46 devstack cinder-volume[86748]: INFO cinder.rpc [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 09 08:57:46 devstack cinder-volume[86748]: INFO cinder.rpc [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_db.sqlalchemy.engines [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86748) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 08:57:46 devstack cinder-volume[86748]: INFO cinder.volume.manager [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] Determined volume DB was empty at startup.
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG cinder.volume.manager [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86748) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 09 08:57:46 devstack cinder-volume[86748]: WARNING stevedore.named [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 09 08:57:46 devstack cinder-volume[86748]: WARNING castellan.key_manager [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 09 08:57:46 devstack cinder-volume[86748]: WARNING cinder.keymgr.conf_key_mgr [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 09 08:57:46 devstack cinder-volume[86748]: INFO cinder.volume.manager [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_db.sqlalchemy.engines [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86748) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 08:57:46 devstack cinder-volume[86748]: INFO oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] Starting 1 workers
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] Started child 87009 {{(pid=86748) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] Full set of CONF: {{(pid=86748) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] ******************************************************************************** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] Configuration options gathered from: {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] ================================================================================ {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] allow_availability_zone_fallback = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] allow_compression_on_image_upload = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] allowed_direct_url_schemes     = [] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] api_rate_limit                 = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] auth_strategy                  = keystone {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_availability_zone      = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[87009]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_host                   = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_name                   = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_stats_polling_interval = 60 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backup_api_class               = cinder.backup.api.API {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backup_name_template           = backup-%s {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backup_use_same_host           = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backup_use_temp_snapshot       = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] chap_password                  = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] chap_username                  =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cinder_internal_tenant_project_id = 79356c3cc0214b7fa8eafad1e2e774a7 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cinder_internal_tenant_user_id = 736217e212304343bcd9365494d11010 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cluster                        = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] compression_format             = gzip {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] compute_api_class              = cinder.compute.nova.API {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] config_dir                     = [] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] config_source                  = [] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] control_exchange               = openstack {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] debug                          = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] default_availability_zone      = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] default_group_type             = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] default_volume_type            = QuobyteHD {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] disk_geometry                  = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] driver_client_cert             = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] driver_client_cert_key         = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] driver_data_namespace          = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] driver_ssl_cert_path           = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] driver_ssl_cert_verify         = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] driver_use_ssl                 = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] enable_new_services            = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] enable_unsupported_driver      = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] enabled_backends               = ['QuobyteHD'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] enforce_multipath_for_image_xfer = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] filter_function                = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance_api_insecure            = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance_api_servers             = ['http://192.168.122.65/image'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance_api_ssl_compression     = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance_ca_certificates_file    = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance_catalog_info            = image:glance:publicURL {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance_certfile                = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance_keyfile                 = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance_num_retries             = 3 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance_request_timeout         = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] goodness_function              = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] graceful_shutdown_timeout      = 5 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] group_api_class                = cinder.group.api.API {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] host                           = devstack {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] image_compress_on_upload       = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] image_conversion_address_space_limit = 1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] image_conversion_cpu_limit     = 60 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] image_conversion_disable       = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] image_upload_use_cinder_backend = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] image_upload_use_internal_tenant = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] image_volume_cache_enabled     = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] image_volume_cache_max_count   = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] image_volume_cache_max_size_gb = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] init_host_max_objects_retrieval = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] instance_format                = [instance: %(uuid)s]  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] iscsi_target_flags             =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] iscsi_write_cache              = on {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] iser_helper                    = tgtadm {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] iser_ip_address                = 192.168.122.65 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] iser_port                      = 3260 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] log_color                      = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] log_config_append              = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] log_dir                        = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] log_file                       = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] log_options                    = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] log_rotate_interval            = 1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] log_rotate_interval_type       = days {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] log_rotation_type              = none {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] max_age                        = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] max_logfile_count              = 30 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] max_logfile_size_mb            = 200 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] max_over_subscription_ratio    = 20.0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] message_reap_interval          = 86400 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] message_ttl                    = 2592000 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] migration_create_volume_timeout_secs = 300 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] monkey_patch                   = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] monkey_patch_modules           = [] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] my_ip                          = 192.168.122.65 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] no_snapshot_gb_quota           = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] num_iser_scan_tries            = 3 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] num_shell_tries                = 3 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] num_volume_device_scan_tries   = 3 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] nvmeof_conn_info_version       = 1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] nvmet_ns_id                    = 10 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] nvmet_port_id                  = 1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] osapi_max_limit                = 1000 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] osapi_volume_ext_list          = [] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] osapi_volume_listen_port       = 8776 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] osapi_volume_use_ssl           = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] osapi_volume_workers           = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] per_volume_size_limit          = -1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] periodic_fuzzy_delay           = 60 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] periodic_interval              = 60 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] public_endpoint                = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] publish_errors                 = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87009) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] quota_backup_gigabytes         = 1000 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] quota_backups                  = 10 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] quota_gigabytes                = 1000 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] quota_groups                   = 10 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] quota_snapshots                = 10 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] quota_volumes                  = 10 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] rate_limit_burst               = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] rate_limit_except_level        = CRITICAL {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] rate_limit_interval            = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] reinit_driver_count            = 3 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] replication_device             = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] report_discard_supported       = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] report_interval                = 120 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] reservation_clean_interval     = 86400 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] reservation_expire             = 86400 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] reserved_image_namespaces      = [] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] reserved_percentage            = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] rpc_response_timeout           = 120 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] run_external_periodic_tasks    = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] scst_target_driver             = iscsi {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] scst_target_iqn_name           = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] service_down_time              = 720 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] shell_completion               = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] snapshot_name_template         = snapshot-%s {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] split_loggers                  = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] state_path                     = /opt/stack/data/cinder {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] storage_availability_zone      = nova {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] storage_protocol               = iSCSI {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] syslog_log_facility            = LOG_USER {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] target_helper                  = lioadm {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] target_ip_address              = 192.168.122.65 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] target_port                    = 3260 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] target_protocol                = iscsi {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] target_secondary_ip_addresses  = [] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] trace_flags                    = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] transport_url                  = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] until_refresh                  = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] use_chap_auth                  = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] use_default_quota_class        = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] use_journal                    = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] use_json                       = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] use_multipath_for_image_xfer   = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] use_stderr                     = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] use_syslog                     = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] verify_glance_signatures       = enabled {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] volume_api_class               = cinder.volume.api.API {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] volume_backend_name            = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] volume_clear                   = zero {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] volume_clear_ionice            = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] volume_clear_size              = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] volume_copy_bps_limit          = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] volume_dd_blocksize            = 1M {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] volume_name_template           = volume-%s {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] volume_service_inithost_offload = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] volume_usage_audit_period      = month {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] zoning_mode                    = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_concurrency.disable_process_locking = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.auth_section = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.auth_type   = password {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.auth_version = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.cache       = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.certfile    = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.include_service_catalog = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.insecure    = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.interface   = public {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.keyfile     = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_password =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcache_username =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.region_name = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.service_type = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.65/identity {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.backend                  = dogpile.cache.null {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.backend_argument         = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.backend_expiration_time  = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.config_prefix            = cache.oslo {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.debug_cache_backend      = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.enable_retry_client      = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.enable_socket_keepalive  = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.enabled                  = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.expiration_time          = 600 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.hashclient_retry_attempts = 2 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.memcache_dead_retry      = 300 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.memcache_pool_maxsize    = 10 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.memcache_sasl_enabled    = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.password                 = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.proxies                  = [] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.redis_db                 = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.redis_server             = localhost:6379 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.retry_attempts           = 2 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.retry_delay              = 0.0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.socket_keepalive_count   = 1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.socket_keepalive_idle    = 1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.socket_keepalive_interval = 1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.socket_timeout           = 1.0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.tls_allowed_ciphers      = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.tls_cafile               = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.tls_certfile             = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.tls_enabled              = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.tls_keyfile              = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cache.username                 = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] coordination.backend_url       = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.asyncio_connection    = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.asyncio_slave_connection = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.backend               = sqlalchemy {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.connection            = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.connection_debug      = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.connection_parameters =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.connection_recycle_time = 3600 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.connection_trace      = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.db_inc_retry_interval = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.db_max_retries        = 20 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.db_max_retry_interval = 10 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.db_retry_interval     = 1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.max_overflow          = 50 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.max_pool_size         = 5 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.max_retries           = 10 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.mysql_wsrep_sync_wait = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.pool_timeout          = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.retry_interval        = 10 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.slave_connection      = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.sqlite_synchronous    = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.synchronous_reader    = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] database.use_db_reconnect      = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87009) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 09 08:57:46 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.quobyte [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 09 08:57:46 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.quobyte [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] profiler.connection_string     = messaging:// {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] profiler.enabled               = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Running cmd (subprocess): mount.quobyte {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] profiler.es_doc_type           = notification {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] profiler.es_scroll_size        = 10000 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] profiler.es_scroll_time        = 2m {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] profiler.filter_error_trace    = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] profiler.hmac_keys             = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] profiler.sentinel_service_name = mymaster {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] profiler.socket_timeout        = 0.1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] profiler.trace_requests        = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] profiler.trace_sqlalchemy      = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] profiler_jaeger.process_tags   = {} {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] profiler_jaeger.service_name_prefix = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] profiler_otlp.service_name_prefix = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_policy.enforce_new_defaults = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_policy.enforce_scope      = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_policy.policy_default_rule = default {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_policy.policy_file        = policy.yaml {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] privsep_osbrick.group          = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] privsep_osbrick.helper_command = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] privsep_osbrick.user           = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cinder_sys_admin.group         = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cinder_sys_admin.helper_command = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] cinder_sys_admin.user          = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] service_user.auth_section      = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] service_user.auth_type         = password {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] service_user.cafile            = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] service_user.certfile          = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] service_user.collect_timing    = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] service_user.insecure          = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] service_user.keyfile           = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] service_user.send_service_user_token = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] service_user.split_loggers     = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] service_user.timeout           = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance.auth_section            = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance.auth_type               = password {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance.certfile                = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance.collect_timing          = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance.insecure                = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance.keyfile                 = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance.region_name             = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance.split_loggers           = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] glance.timeout                 = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.backend_availability_zone = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.chap_password = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.chap_username =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.disk_geometry = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.driver_client_cert = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.driver_client_cert_key = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.driver_data_namespace = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.driver_use_ssl = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.extra_capabilities = {} {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.filter_function = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.goodness_function = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.iscsi_target_flags =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.iscsi_write_cache = on {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.iser_helper   = tgtadm {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.iser_ip_address = 192.168.122.65 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.iser_port     = 3260 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.nas_host      =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.nas_login     = admin {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.nas_mount_options = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.nas_password  = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.nas_private_key =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.nas_share_path =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.num_shell_tries = 3 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.quobyte_volume_url = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.replication_device = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.report_discard_supported = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.reserved_percentage = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.target_helper = tgtadm {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.target_ip_address = 192.168.122.65 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.target_port   = 3260 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.target_protocol = iscsi {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.trace_flags   = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.unique_fqdn_network = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.use_chap_auth = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.volume_backend_name = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.volume_clear  = zero {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.volume_clear_ionice = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.volume_clear_size = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_reports.file_event_handler = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_reports.log_dir           = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.backend_availability_zone = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.backend_host         = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.chap_password        = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.chap_username        = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack quobyte-client[87010]: Reading configuration file: /etc/quobyte/client.cfg
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.chiscsi_conf         = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.disk_geometry        = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.driver_client_cert   = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.driver_data_namespace = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack quobyte-client[87010]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.driver_use_ssl       = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.extra_capabilities   = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.filter_function      = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.goodness_function    = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.iser_helper          = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.iser_ip_address      = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.iser_port            = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.iser_target_prefix   = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.nas_host             = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.nas_login            = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.nas_mount_options    = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.nas_password         = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.nas_private_key      = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.nas_share_path       = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.nas_ssh_port         = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.num_shell_tries      = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.nvmet_port_id        = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.replication_device   = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.report_discard_supported = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.reserved_percentage  = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.scst_target_driver   = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.storage_protocol     = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.target_helper        = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.target_ip_address    = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.target_port          = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.target_prefix        = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.target_protocol      = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.trace_flags          = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.use_chap_auth        = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.volume_clear         = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.volume_clear_size    = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] QuobyteHD.volumes_dir          = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.ssl      = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_notifications.driver = [] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_notifications.retry = -1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] key_manager.fixed_key          = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.barbican_api_version  = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.barbican_endpoint     = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.barbican_endpoint_type = public {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.barbican_region_name  = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.cafile                = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.certfile              = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.collect_timing        = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.insecure              = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.keyfile               = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.number_of_retries     = 60 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.retry_delay           = 1 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.send_service_user_token = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.split_loggers         = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.timeout               = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.verify_ssl            = True {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican.verify_ssl_path       = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican_service_user.auth_section = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican_service_user.auth_type = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican_service_user.cafile   = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican_service_user.certfile = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican_service_user.collect_timing = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican_service_user.insecure = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican_service_user.keyfile  = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican_service_user.split_loggers = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] barbican_service_user.timeout  = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] vault.approle_role_id          = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] vault.approle_secret_id        = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] vault.kv_mountpoint            = secret {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] vault.kv_path                  = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack sudo[87011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] vault.kv_version               = 2 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] vault.namespace                = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] vault.root_token_id            = **** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] vault.ssl_ca_crt_file          = None {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] vault.timeout                  = 60.0 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] vault.use_ssl                  = False {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 09 08:57:46 devstack cinder-volume[86748]: DEBUG oslo_service.backend._eventlet.service [None req-b849c534-3be0-4702-9036-9e6c6f73d70a None None] ******************************************************************************** {{(pid=86748) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 09 08:57:47 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root
Jul 09 08:57:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.670s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:57:47 devstack cinder-volume[87009]: INFO cinder.volume.driver [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Driver hasn't implemented _init_vendor_properties()
Jul 09 08:57:47 devstack cinder-volume[87009]: DEBUG cinder.volume.driver [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87009) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 09 08:57:47 devstack cinder-volume[87009]: DEBUG oslo_db.sqlalchemy.engines [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87009) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 09 08:57:47 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writer thread running {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 09 08:57:47 devstack cinder-volume[87009]: DEBUG cinder.db.api [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Building query based on filter {{(pid=87009) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 09 08:57:47 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87009) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 09 08:57:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:57:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:57:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:57:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:57:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:57:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:57:47 devstack cinder-volume[87009]: INFO cinder.keymgr.migration [None req-ce5d7ce1-6334-40d6-83b6-62c6c8b7fa24 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 09 08:57:47 devstack sudo[87044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:57:47 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:57:48 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root
Jul 09 08:57:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.636s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:57:48 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:57:48 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Driver initialization completed successfully.
Jul 09 08:57:48 devstack cinder-volume[87009]: INFO cinder.manager [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Initiating service 3 cleanup
Jul 09 08:57:48 devstack cinder-volume[87009]: INFO cinder.manager [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Service 3 cleanup completed.
Jul 09 08:57:48 devstack cinder-volume[87009]: DEBUG cinder.service [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Creating RPC server for service cinder-volume {{(pid=87009) start /opt/stack/cinder/cinder/service.py:231}}
Jul 09 08:57:48 devstack cinder-volume[87009]: DEBUG cinder.service [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87009) start /opt/stack/cinder/cinder/service.py:237}}
Jul 09 08:57:48 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 09 08:57:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:57:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:57:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:57:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:57:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:57:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:57:48 devstack sudo[87052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:57:48 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:57:49 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root
Jul 09 08:57:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.594s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:57:49 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-448f2fa5-99a4-435a-912e-27257b750d95 None None] Driver post RPC initialization completed successfully.
Jul 09 08:57:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 08:57:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 6 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 08:57:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 08:57:56 devstack cinder-volume[86748]: DEBUG dbcounter [-] [86748] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86748) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 08:57:58 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=3 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 08:57:59 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 08:58:46 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b1ea964e-6e29-483f-9812-2e1496083fdf tempest-GroupsTest-2091117711 None] Group tempest-Group1-1677765947: creating
Jul 09 08:58:46 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b1ea964e-6e29-483f-9812-2e1496083fdf tempest-GroupsTest-2091117711 None] Group tempest-Group1-1677765947: created successfully
Jul 09 08:58:46 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b1ea964e-6e29-483f-9812-2e1496083fdf tempest-GroupsTest-2091117711 None] Create group completed successfully.
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Flow 'volume_create_manager' (a12f4684-1379-4e4c-848f-b822c2c577de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbee15a7-8594-4ae9-a9f4-eb9a56e4455b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbee15a7-8594-4ae9-a9f4-eb9a56e4455b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T06:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1138628246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df094010-18a7-44e3-b0d2-60cad9e531f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c06d7d8911541aa98f04e596795f6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:58:47Z,use_quota=True,user_id='1b8eb0d6673e40d0a8b3740d11e33237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2239953-4eda-40c6-91bd-4e38c32044c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2239953-4eda-40c6-91bd-4e38c32044c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a43e9c-3d53-4978-bded-b6efe53a7105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a43e9c-3d53-4978-bded-b6efe53a7105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df094010-18a7-44e3-b0d2-60cad9e531f3', 'volume_name': 'volume-df094010-18a7-44e3-b0d2-60cad9e531f3', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0ef07b-9594-47ad-8464-adedcecdda5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0ef07b-9594-47ad-8464-adedcecdda5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abae5a29-dc78-4775-a6ac-a45c9af37169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:58:46 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Volume df094010-18a7-44e3-b0d2-60cad9e531f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df094010-18a7-44e3-b0d2-60cad9e531f3', 'volume_size': 1}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T06:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1138628246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df094010-18a7-44e3-b0d2-60cad9e531f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c06d7d8911541aa98f04e596795f6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:58:47Z,use_quota=True,user_id='1b8eb0d6673e40d0a8b3740d11e33237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Creating volume df094010-18a7-44e3-b0d2-60cad9e531f3 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 08:58:46 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 08:58:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:58:46 devstack sudo[87533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3 1073741824
Jul 09 08:58:46 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:58:47 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f4d1d205-5bba-43c0-8631-5080ad85a4b3 tempest-GroupsTest-2091117711 None] Group tempest-Group2-1862779596: creating
Jul 09 08:58:47 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f4d1d205-5bba-43c0-8631-5080ad85a4b3 tempest-GroupsTest-2091117711 None] Group tempest-Group2-1862779596: created successfully
Jul 09 08:58:47 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f4d1d205-5bba-43c0-8631-5080ad85a4b3 tempest-GroupsTest-2091117711 None] Create group completed successfully.
Jul 09 08:58:48 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root
Jul 09 08:58:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3 1073741824" returned: 0 in 1.999s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:58:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:58:49 devstack sudo[87851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3
Jul 09 08:58:49 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:58:50 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3" returned: 0 in 1.520s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] <== create_volume: return (3710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.715s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abae5a29-dc78-4775-a6ac-a45c9af37169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df094010-18a7-44e3-b0d2-60cad9e531f3', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6aacf6-22a6-45e2-84b1-fe849bff9a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:58:50 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Volume volume-df094010-18a7-44e3-b0d2-60cad9e531f3 (df094010-18a7-44e3-b0d2-60cad9e531f3): created successfully
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6aacf6-22a6-45e2-84b1-fe849bff9a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Flow 'volume_create_manager' (a12f4684-1379-4e4c-848f-b822c2c577de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Flow 'volume_create_manager' (4c0ffc90-cb78-40c3-8b9d-ba9fee11c595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb26608-f780-4e44-873d-31500fe9dfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:58:50 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-79c18e7e-4ea1-48c8-ab85-f39ef5e19d94 tempest-DeleteServersTestJSON-1331404752 None] Created volume successfully.
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb26608-f780-4e44-873d-31500fe9dfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T06:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1479153072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2a052619-ed9c-4930-b064-8a83c8bc7b4c,host='devstack@QuobyteHD#QuobyteHD',id=c50e3880-c9a5-4c89-8fdd-4690a429344f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1fcd9ae24746e0b5159b2ba4a46fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:58:51Z,use_quota=True,user_id='5e5f150eb8f3464c98f9a25d972cc9a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49d64d63-41da-4484-8b2d-bbc32a371ed4),volume_type_id=49d64d63-41da-4484-8b2d-bbc32a371ed4)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcaf7de8-a470-4967-b288-e29ad709498b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcaf7de8-a470-4967-b288-e29ad709498b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bc5dab-29bd-45ae-8df2-41ec5a2fbba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bc5dab-29bd-45ae-8df2-41ec5a2fbba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c50e3880-c9a5-4c89-8fdd-4690a429344f', 'volume_name': 'volume-c50e3880-c9a5-4c89-8fdd-4690a429344f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17a9988-693c-457b-8c71-369669a1fd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17a9988-693c-457b-8c71-369669a1fd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094343ef-276d-42e5-8b24-9d0dc5fdfccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:58:50 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Volume c50e3880-c9a5-4c89-8fdd-4690a429344f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c50e3880-c9a5-4c89-8fdd-4690a429344f', 'volume_size': 1}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2a052619-ed9c-4930-b064-8a83c8bc7b4c,created_at=2026-07-09T06:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1479153072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2a052619-ed9c-4930-b064-8a83c8bc7b4c,host='devstack@QuobyteHD#QuobyteHD',id=c50e3880-c9a5-4c89-8fdd-4690a429344f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1fcd9ae24746e0b5159b2ba4a46fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:58:51Z,use_quota=True,user_id='5e5f150eb8f3464c98f9a25d972cc9a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49d64d63-41da-4484-8b2d-bbc32a371ed4),volume_type_id=49d64d63-41da-4484-8b2d-bbc32a371ed4)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 08:58:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Creating volume c50e3880-c9a5-4c89-8fdd-4690a429344f {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 08:58:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:58:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:58:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:58:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:58:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:58:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 08:58:51 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 08:58:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c50e3880-c9a5-4c89-8fdd-4690a429344f 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:58:51 devstack sudo[87859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c50e3880-c9a5-4c89-8fdd-4690a429344f 1073741824
Jul 09 08:58:51 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:58:52 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root
Jul 09 08:58:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c50e3880-c9a5-4c89-8fdd-4690a429344f 1073741824" returned: 0 in 1.590s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:58:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c50e3880-c9a5-4c89-8fdd-4690a429344f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:58:52 devstack sudo[87945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c50e3880-c9a5-4c89-8fdd-4690a429344f
Jul 09 08:58:52 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:58:53 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root
Jul 09 08:58:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c50e3880-c9a5-4c89-8fdd-4690a429344f" returned: 0 in 0.740s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:58:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] <== create_volume: return (2390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 08:58:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.395s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:58:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094343ef-276d-42e5-8b24-9d0dc5fdfccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c50e3880-c9a5-4c89-8fdd-4690a429344f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:58:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984a711e-ef7d-40ca-a161-88c01cb8f7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:58:53 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Volume volume-c50e3880-c9a5-4c89-8fdd-4690a429344f (c50e3880-c9a5-4c89-8fdd-4690a429344f): created successfully
Jul 09 08:58:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984a711e-ef7d-40ca-a161-88c01cb8f7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:58:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Flow 'volume_create_manager' (4c0ffc90-cb78-40c3-8b9d-ba9fee11c595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:58:53 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-c55c6397-e125-4380-87e5-faf5fe7df002 tempest-GroupsTest-2091117711 None] Created volume successfully.
Jul 09 08:58:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 08:58:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:58:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:58:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:58:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:58:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:58:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:58:54 devstack sudo[87951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:58:54 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:58:54 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root
Jul 09 08:58:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.885s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:58:54 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:58:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 08:58:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 6 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 08:58:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 08:58:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Acquiring lock "cinder-quobyte-c50e3880-c9a5-4c89-8fdd-4690a429344f" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 08:58:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Lock "cinder-quobyte-c50e3880-c9a5-4c89-8fdd-4690a429344f" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 08:58:55 devstack cinder-volume[87009]: INFO oslo.privsep.daemon [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpi6ty2j2d/privsep.sock']
Jul 09 08:58:55 devstack sudo[87957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpi6ty2j2d/privsep.sock
Jul 09 08:58:55 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 09 08:58:56 devstack cinder-volume[87009]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 09 08:58:57 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root
Jul 09 08:58:57 devstack cinder-volume[87009]: INFO oslo.privsep.daemon [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Spawned new privsep daemon via rootwrap
Jul 09 08:58:57 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Accepted privsep connection to /tmp/tmpi6ty2j2d/privsep.sock {{(pid=87009) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 09 08:58:57 devstack cinder-volume[87009]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 09 08:58:57 devstack cinder-volume[87009]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 09 08:58:57 devstack cinder-volume[87009]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 09 08:58:57 devstack cinder-volume[87009]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87966
Jul 09 08:58:57 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e00b56-038a-45f1-9cec-e8499da68b3b]: (2,) {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 08:58:57 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a30850-1ae9-4572-b591-448627c46940]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 08:58:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c50e3880-c9a5-4c89-8fdd-4690a429344f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:58:57 devstack sudo[87969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c50e3880-c9a5-4c89-8fdd-4690a429344f
Jul 09 08:58:57 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:58:58 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root
Jul 09 08:58:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c50e3880-c9a5-4c89-8fdd-4690a429344f" returned: 0 in 1.206s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:58:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c50e3880-c9a5-4c89-8fdd-4690a429344f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:58:58 devstack sudo[88005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c50e3880-c9a5-4c89-8fdd-4690a429344f
Jul 09 08:58:58 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:58:59 devstack cinder-volume[87009]: WARNING py.warnings [req-59d7b831-949e-4a9f-8141-b1dc6f3e47b8 req-be8f42ac-aa97-4bd3-9e51-b314cd71fa5f tempest-DeleteServersTestJSON-1331404752 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Jul 09 08:58:59 devstack cinder-volume[87009]:   .first()
Jul 09 08:58:59 devstack cinder-volume[87009]: 
Jul 09 08:58:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-59d7b831-949e-4a9f-8141-b1dc6f3e47b8 req-be8f42ac-aa97-4bd3-9e51-b314cd71fa5f tempest-DeleteServersTestJSON-1331404752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:58:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-59d7b831-949e-4a9f-8141-b1dc6f3e47b8 req-be8f42ac-aa97-4bd3-9e51-b314cd71fa5f tempest-DeleteServersTestJSON-1331404752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:58:59 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ae4c17-4aca-47ce-bdfd-5b813bd156a8]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 08:58:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-59d7b831-949e-4a9f-8141-b1dc6f3e47b8 req-be8f42ac-aa97-4bd3-9e51-b314cd71fa5f tempest-DeleteServersTestJSON-1331404752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:58:59 devstack sudo[88011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3
Jul 09 08:58:59 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:58:59 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root
Jul 09 08:58:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c50e3880-c9a5-4c89-8fdd-4690a429344f" returned: 0 in 1.337s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Lock "cinder-quobyte-c50e3880-c9a5-4c89-8fdd-4690a429344f" released by "delete_volume" :: held 4.456s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 08:59:00 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Created reservations ['a6c9e47b-b3c9-4a3c-807d-94af1db796ac'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 08:59:00 devstack cinder-volume[87009]: WARNING cinder.quota [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1395557259 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1395557259, it is now deprecated. Please use the default quota class for default quota.
Jul 09 08:59:00 devstack cinder-volume[87009]: WARNING cinder.quota [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1395557259 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1395557259, it is now deprecated. Please use the default quota class for default quota.
Jul 09 08:59:00 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-59d7b831-949e-4a9f-8141-b1dc6f3e47b8 req-be8f42ac-aa97-4bd3-9e51-b314cd71fa5f tempest-DeleteServersTestJSON-1331404752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3" returned: 0 in 1.284s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-59d7b831-949e-4a9f-8141-b1dc6f3e47b8 req-be8f42ac-aa97-4bd3-9e51-b314cd71fa5f tempest-DeleteServersTestJSON-1331404752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.319s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:00 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Created reservations ['2700f1b0-be47-4e57-9c53-763dfa9bb174', '02e39955-83b4-490c-aaa7-2d4f9a8e3faa', '34977714-1ec7-4498-959b-ee651b1e7480', '82f1fa66-dbae-4242-8fc4-e97f8b6bb0e0'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 08:59:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-59d7b831-949e-4a9f-8141-b1dc6f3e47b8 req-be8f42ac-aa97-4bd3-9e51-b314cd71fa5f tempest-DeleteServersTestJSON-1331404752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-df094010-18a7-44e3-b0d2-60cad9e531f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '838b56b2-207c-4747-a529-e852deab92a4', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 08:59:00 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-59d7b831-949e-4a9f-8141-b1dc6f3e47b8 req-be8f42ac-aa97-4bd3-9e51-b314cd71fa5f tempest-DeleteServersTestJSON-1331404752 None] attachment_update completed successfully.
Jul 09 08:59:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:59:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:59:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:01 devstack sudo[88039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:59:01 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:02 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.419s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:02 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:59:02 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-cf30e9bb-ae47-43cb-a9e5-5586a74ce9d4 tempest-GroupsTest-2091117711 None] Created reservations ['2178a206-8231-4bef-b094-eb83995b84a5'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 08:59:02 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-614df129-ef0e-48f6-a38d-0e61620a7e38 tempest-GroupsTest-2091117711 None] Delete group completed successfully.
Jul 09 08:59:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cf30e9bb-ae47-43cb-a9e5-5586a74ce9d4 tempest-GroupsTest-2091117711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cf30e9bb-ae47-43cb-a9e5-5586a74ce9d4 tempest-GroupsTest-2091117711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cf30e9bb-ae47-43cb-a9e5-5586a74ce9d4 tempest-GroupsTest-2091117711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:59:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cf30e9bb-ae47-43cb-a9e5-5586a74ce9d4 tempest-GroupsTest-2091117711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:59:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cf30e9bb-ae47-43cb-a9e5-5586a74ce9d4 tempest-GroupsTest-2091117711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cf30e9bb-ae47-43cb-a9e5-5586a74ce9d4 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:02 devstack sudo[88426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:59:02 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:03 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cf30e9bb-ae47-43cb-a9e5-5586a74ce9d4 tempest-GroupsTest-2091117711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.781s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:03 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-cf30e9bb-ae47-43cb-a9e5-5586a74ce9d4 tempest-GroupsTest-2091117711 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:59:03 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-cf30e9bb-ae47-43cb-a9e5-5586a74ce9d4 tempest-GroupsTest-2091117711 None] Delete group completed successfully.
Jul 09 08:59:04 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2dd63be0-2560-4eeb-985c-bed2efbe59e6 tempest-GroupsTest-2091117711 None] Group tempest-GroupsTest-Group-1372254143: creating
Jul 09 08:59:04 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2dd63be0-2560-4eeb-985c-bed2efbe59e6 tempest-GroupsTest-2091117711 None] Group tempest-GroupsTest-Group-1372254143: created successfully
Jul 09 08:59:04 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2dd63be0-2560-4eeb-985c-bed2efbe59e6 tempest-GroupsTest-2091117711 None] Create group completed successfully.
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Flow 'volume_create_manager' (f1653f10-2e01-44cb-94e6-4704c93aa712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944f4e5e-43b8-4390-af65-c9293ca673ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944f4e5e-43b8-4390-af65-c9293ca673ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T06:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1245356168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6060bc9a-148a-40c9-b3a9-35cb7ec2cf81,host='devstack@QuobyteHD#QuobyteHD',id=77f8524a-895c-46b8-baea-bfcff12c8b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1fcd9ae24746e0b5159b2ba4a46fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:59:06Z,use_quota=True,user_id='5e5f150eb8f3464c98f9a25d972cc9a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1681bd87-177b-4982-ad46-0066ecc45f08),volume_type_id=1681bd87-177b-4982-ad46-0066ecc45f08)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b1f1fc-ac0f-40a7-9846-2229009512a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b1f1fc-ac0f-40a7-9846-2229009512a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63592658-c75d-4835-b2f6-b25a3009f159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63592658-c75d-4835-b2f6-b25a3009f159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f8524a-895c-46b8-baea-bfcff12c8b6f', 'volume_name': 'volume-77f8524a-895c-46b8-baea-bfcff12c8b6f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216ebeb5-9409-4f5c-a153-46253a5f7c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216ebeb5-9409-4f5c-a153-46253a5f7c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd65d14f-b794-41ba-9486-8e23cb71518d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:06 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Volume 77f8524a-895c-46b8-baea-bfcff12c8b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f8524a-895c-46b8-baea-bfcff12c8b6f', 'volume_size': 1}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6060bc9a-148a-40c9-b3a9-35cb7ec2cf81,created_at=2026-07-09T06:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1245356168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6060bc9a-148a-40c9-b3a9-35cb7ec2cf81,host='devstack@QuobyteHD#QuobyteHD',id=77f8524a-895c-46b8-baea-bfcff12c8b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1fcd9ae24746e0b5159b2ba4a46fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:59:06Z,use_quota=True,user_id='5e5f150eb8f3464c98f9a25d972cc9a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1681bd87-177b-4982-ad46-0066ecc45f08),volume_type_id=1681bd87-177b-4982-ad46-0066ecc45f08)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Creating volume 77f8524a-895c-46b8-baea-bfcff12c8b6f {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 08:59:06 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 08:59:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-77f8524a-895c-46b8-baea-bfcff12c8b6f 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:06 devstack sudo[88437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-77f8524a-895c-46b8-baea-bfcff12c8b6f 1073741824
Jul 09 08:59:06 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:07 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-77f8524a-895c-46b8-baea-bfcff12c8b6f 1073741824" returned: 0 in 1.178s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-77f8524a-895c-46b8-baea-bfcff12c8b6f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:07 devstack sudo[88503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-77f8524a-895c-46b8-baea-bfcff12c8b6f
Jul 09 08:59:07 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:08 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-77f8524a-895c-46b8-baea-bfcff12c8b6f" returned: 0 in 1.006s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] <== create_volume: return (2287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 08:59:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd65d14f-b794-41ba-9486-8e23cb71518d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f8524a-895c-46b8-baea-bfcff12c8b6f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6127dd-822f-4f22-b160-470cb142a98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:08 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Volume volume-77f8524a-895c-46b8-baea-bfcff12c8b6f (77f8524a-895c-46b8-baea-bfcff12c8b6f): created successfully
Jul 09 08:59:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6127dd-822f-4f22-b160-470cb142a98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Flow 'volume_create_manager' (f1653f10-2e01-44cb-94e6-4704c93aa712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:59:08 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-31d601d4-46fe-4a3c-8d12-26a4bf44e387 tempest-GroupsTest-2091117711 None] Created volume successfully.
Jul 09 08:59:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-38e9eebf-54f0-40ac-8bdb-e4c0a3de4bd3 req-f753b048-7063-4848-b6d1-b5b3bf723ca0 tempest-DeleteServersTestJSON-1331404752 None] Terminate volume connection completed successfully.
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-38e9eebf-54f0-40ac-8bdb-e4c0a3de4bd3 req-f753b048-7063-4848-b6d1-b5b3bf723ca0 tempest-DeleteServersTestJSON-1331404752 None] Deleting attachment 838b56b2-207c-4747-a529-e852deab92a4. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Flow 'volume_create_manager' (d07eaedf-6447-47db-bdb9-426de042f2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9241d69-1c68-4460-a732-02cbc715ae66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9241d69-1c68-4460-a732-02cbc715ae66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T06:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1270876799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6060bc9a-148a-40c9-b3a9-35cb7ec2cf81,host='devstack@QuobyteHD#QuobyteHD',id=32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1fcd9ae24746e0b5159b2ba4a46fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:59:11Z,use_quota=True,user_id='5e5f150eb8f3464c98f9a25d972cc9a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1681bd87-177b-4982-ad46-0066ecc45f08),volume_type_id=1681bd87-177b-4982-ad46-0066ecc45f08)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bce966-ae90-4695-afff-a954c973fd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bce966-ae90-4695-afff-a954c973fd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd14c3ff-9983-447f-9ff8-8e5317741a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd14c3ff-9983-447f-9ff8-8e5317741a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31', 'volume_name': 'volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fedc4b5a-1ab1-4398-8924-9296b0426ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fedc4b5a-1ab1-4398-8924-9296b0426ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cebb3e6b-05b7-42ad-bf8a-c118b334715c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:10 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Volume 32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31', 'volume_size': 1}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6060bc9a-148a-40c9-b3a9-35cb7ec2cf81,created_at=2026-07-09T06:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1270876799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6060bc9a-148a-40c9-b3a9-35cb7ec2cf81,host='devstack@QuobyteHD#QuobyteHD',id=32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1fcd9ae24746e0b5159b2ba4a46fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:59:11Z,use_quota=True,user_id='5e5f150eb8f3464c98f9a25d972cc9a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1681bd87-177b-4982-ad46-0066ecc45f08),volume_type_id=1681bd87-177b-4982-ad46-0066ecc45f08)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Creating volume 32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 08:59:10 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 08:59:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:10 devstack sudo[88557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31 1073741824
Jul 09 08:59:10 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:11 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31 1073741824" returned: 0 in 0.910s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:11 devstack sudo[88564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31
Jul 09 08:59:11 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:12 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31" returned: 0 in 0.835s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 08:59:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cebb3e6b-05b7-42ad-bf8a-c118b334715c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952c7ee3-1b1b-42d6-9390-dc97bf2036e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:12 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Volume volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31 (32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31): created successfully
Jul 09 08:59:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952c7ee3-1b1b-42d6-9390-dc97bf2036e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Flow 'volume_create_manager' (d07eaedf-6447-47db-bdb9-426de042f2e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:59:12 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-390314a2-404c-4a1b-84dc-efe9f32d49e8 tempest-GroupsTest-2091117711 None] Created volume successfully.
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Flow 'volume_create_manager' (22563227-ffd3-424e-ada2-3d0eeb58439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab31068-01a5-4a97-a941-f26d5ca5c722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab31068-01a5-4a97-a941-f26d5ca5c722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T06:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1978316124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74a5833-8e53-452c-ab19-9d6faf075066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e8631d31f24bcc9af579a29541b9e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:59:13Z,use_quota=True,user_id='bc49d9507b36412c9728b19af0616141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2a9b29-d4fc-4a11-96a3-26dac9666323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2a9b29-d4fc-4a11-96a3-26dac9666323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6f9256-33b8-4e7c-90c2-6d76e2f4ae61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6f9256-33b8-4e7c-90c2-6d76e2f4ae61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c74a5833-8e53-452c-ab19-9d6faf075066', 'volume_name': 'volume-c74a5833-8e53-452c-ab19-9d6faf075066', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885926e7-b406-4b6c-9f5d-8e3318dbda7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885926e7-b406-4b6c-9f5d-8e3318dbda7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfb7df8-a57f-4dad-a0dd-e84fe9644830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:13 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Volume c74a5833-8e53-452c-ab19-9d6faf075066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c74a5833-8e53-452c-ab19-9d6faf075066', 'volume_size': 1}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T06:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1978316124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74a5833-8e53-452c-ab19-9d6faf075066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e8631d31f24bcc9af579a29541b9e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:59:13Z,use_quota=True,user_id='bc49d9507b36412c9728b19af0616141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Creating volume c74a5833-8e53-452c-ab19-9d6faf075066 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 08:59:13 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c74a5833-8e53-452c-ab19-9d6faf075066 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:13 devstack sudo[88567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c74a5833-8e53-452c-ab19-9d6faf075066 1073741824
Jul 09 08:59:13 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-353b6527-ae66-4548-8c0a-89c2467db8e2 tempest-GroupsTest-2091117711 None] Update group completed successfully.
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Acquiring lock "cinder-df094010-18a7-44e3-b0d2-60cad9e531f3-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 08:59:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Lock "cinder-df094010-18a7-44e3-b0d2-60cad9e531f3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 08:59:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Acquiring lock "cinder-quobyte-df094010-18a7-44e3-b0d2-60cad9e531f3" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 08:59:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Lock "cinder-quobyte-df094010-18a7-44e3-b0d2-60cad9e531f3" acquired by "delete_volume" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 08:59:14 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cf140f-bfc0-4acf-b920-b44d3a09d571]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 08:59:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:14 devstack sudo[88572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3
Jul 09 08:59:14 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:14 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c74a5833-8e53-452c-ab19-9d6faf075066 1073741824" returned: 0 in 1.043s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c74a5833-8e53-452c-ab19-9d6faf075066 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:14 devstack sudo[88574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c74a5833-8e53-452c-ab19-9d6faf075066
Jul 09 08:59:14 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:15 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d88a6a8e-dc8b-4ce4-91bd-6ef1aeab80c3 tempest-GroupsTest-2091117711 None] Update group completed successfully.
Jul 09 08:59:15 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3" returned: 0 in 0.959s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:15 devstack sudo[88580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3
Jul 09 08:59:15 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:15 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c74a5833-8e53-452c-ab19-9d6faf075066" returned: 0 in 1.084s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 08:59:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acfb7df8-a57f-4dad-a0dd-e84fe9644830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c74a5833-8e53-452c-ab19-9d6faf075066', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a2d52c-7627-4607-937f-bbed6214b809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:15 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Volume volume-c74a5833-8e53-452c-ab19-9d6faf075066 (c74a5833-8e53-452c-ab19-9d6faf075066): created successfully
Jul 09 08:59:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a2d52c-7627-4607-937f-bbed6214b809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Flow 'volume_create_manager' (22563227-ffd3-424e-ada2-3d0eeb58439c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:59:15 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-75ed1677-d967-4bd7-96c8-7a34f2d0320c tempest-ServersNegativeTestJSON-200532840 None] Created volume successfully.
Jul 09 08:59:15 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df094010-18a7-44e3-b0d2-60cad9e531f3" returned: 0 in 0.829s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:15 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Lock "cinder-quobyte-df094010-18a7-44e3-b0d2-60cad9e531f3" released by "delete_volume" :: held 1.829s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 08:59:15 devstack cinder-volume[87009]: WARNING cinder.quota [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 09 08:59:15 devstack cinder-volume[87009]: WARNING cinder.quota [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 09 08:59:15 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Created reservations ['c82d7852-f760-48e0-ac38-570ea70de581', 'f23d5b4f-29c1-43d0-bbdf-e5612e1876ba', '760b9ca9-d81a-42cd-beab-ae159422a7ea', '20f3519b-0d2c-415d-bb59-079d1dc5c4dc'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 08:59:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:59:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:59:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:16 devstack sudo[88584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:59:16 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Acquiring lock "cinder-quobyte-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 08:59:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Lock "cinder-quobyte-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31" acquired by "delete_volume" :: waited 0.033s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 08:59:16 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[77afe4df-e57d-4718-8dfa-19589172929d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 08:59:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:17 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.988s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:17 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:59:17 devstack sudo[88587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31
Jul 09 08:59:17 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:17 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Deleted volume successfully.
Jul 09 08:59:17 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-954950a6-268a-49fe-b74b-7377f9d722cf tempest-DeleteServersTestJSON-1331404752 None] Lock "cinder-df094010-18a7-44e3-b0d2-60cad9e531f3-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 08:59:17 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31" returned: 0 in 0.950s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:17 devstack sudo[88592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31
Jul 09 08:59:17 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:18 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31" returned: 0 in 0.829s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Lock "cinder-quobyte-32572a3e-ff9a-4ef5-b7a1-45d3d9cd5e31" released by "delete_volume" :: held 1.845s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 08:59:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Acquiring lock "cinder-quobyte-77f8524a-895c-46b8-baea-bfcff12c8b6f" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 08:59:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Lock "cinder-quobyte-77f8524a-895c-46b8-baea-bfcff12c8b6f" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 08:59:18 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63466f5-f639-434a-81fb-d12f5022e8c5]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 08:59:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-77f8524a-895c-46b8-baea-bfcff12c8b6f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:18 devstack sudo[88597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-77f8524a-895c-46b8-baea-bfcff12c8b6f
Jul 09 08:59:18 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:19 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-77f8524a-895c-46b8-baea-bfcff12c8b6f" returned: 0 in 0.890s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-77f8524a-895c-46b8-baea-bfcff12c8b6f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:19 devstack sudo[88602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-77f8524a-895c-46b8-baea-bfcff12c8b6f
Jul 09 08:59:19 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:20 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-77f8524a-895c-46b8-baea-bfcff12c8b6f" returned: 0 in 0.774s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Lock "cinder-quobyte-77f8524a-895c-46b8-baea-bfcff12c8b6f" released by "delete_volume" :: held 1.706s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Created reservations ['0ca401e2-b225-47e7-9fb2-eca3f648130f'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 08:59:20 devstack cinder-volume[87009]: WARNING cinder.quota [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-258576712 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-258576712, it is now deprecated. Please use the default quota class for default quota.
Jul 09 08:59:20 devstack cinder-volume[87009]: WARNING cinder.quota [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-258576712 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-258576712, it is now deprecated. Please use the default quota class for default quota.
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Created reservations ['1fb69109-2259-4abc-80eb-a303d65232f1', '20936f4b-25aa-4ed5-bc79-4104c9948365', 'ee37f54c-a6b7-4435-91c8-24e587a390ec', '915244a2-6b8d-4617-8145-8101050ec8d1'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Flow 'volume_create_manager' (ac948d7c-73ae-4367-9326-fbdd85a828e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd89013-d217-4eb8-91cd-68c2b40d7777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd89013-d217-4eb8-91cd-68c2b40d7777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T06:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2033717840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8a0805-4288-4173-b96b-9ed8a94e69e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e8631d31f24bcc9af579a29541b9e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:59:21Z,use_quota=True,user_id='bc49d9507b36412c9728b19af0616141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e785584c-59f4-40bb-9e36-467ad999b583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e785584c-59f4-40bb-9e36-467ad999b583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7607b2-c687-4b17-818d-9e4a6b487260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7607b2-c687-4b17-818d-9e4a6b487260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd8a0805-4288-4173-b96b-9ed8a94e69e7', 'volume_name': 'volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c048ec-9075-4c1e-9183-e124a30ca310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c048ec-9075-4c1e-9183-e124a30ca310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af28de3-2850-4f5c-8c7c-b582532970d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:20 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Volume dd8a0805-4288-4173-b96b-9ed8a94e69e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7', 'volume_size': 1}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T06:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2033717840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8a0805-4288-4173-b96b-9ed8a94e69e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e8631d31f24bcc9af579a29541b9e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:59:21Z,use_quota=True,user_id='bc49d9507b36412c9728b19af0616141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Creating volume dd8a0805-4288-4173-b96b-9ed8a94e69e7 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 08:59:20 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:20 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Created reservations ['693184bf-a9af-4364-ace8-07fde734a4a5', 'f4629193-29f8-4ca6-999b-b0ef02eadda6', '95b68f62-2986-4fc8-a3d5-9be772858fe3', '5acc1ddc-8af3-4546-aa9a-9eb378266ef4'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 08:59:20 devstack sudo[88606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7 1073741824
Jul 09 08:59:20 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:59:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:59:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:21 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:59:21 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:21 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.952s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:21 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:59:22 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-61c4d6e3-d4fb-489d-af72-5af7c2348fc0 tempest-GroupsTest-2091117711 None] Delete group completed successfully.
Jul 09 08:59:22 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7 1073741824" returned: 0 in 1.236s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:22 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7
Jul 09 08:59:22 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:23 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7" returned: 0 in 1.101s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] <== create_volume: return (2386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 08:59:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.391s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af28de3-2850-4f5c-8c7c-b582532970d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75e14c7-0f12-45fe-8dfc-38f41ebb7e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:23 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Volume volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7 (dd8a0805-4288-4173-b96b-9ed8a94e69e7): created successfully
Jul 09 08:59:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75e14c7-0f12-45fe-8dfc-38f41ebb7e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Flow 'volume_create_manager' (ac948d7c-73ae-4367-9326-fbdd85a828e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:59:23 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-1c4ffc8f-7c96-49e9-8c56-39158149e767 tempest-ServersNegativeTestJSON-200532840 None] Created volume successfully.
Jul 09 08:59:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Acquiring lock "cinder-dd8a0805-4288-4173-b96b-9ed8a94e69e7-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 08:59:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Lock "cinder-dd8a0805-4288-4173-b96b-9ed8a94e69e7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 08:59:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Acquiring lock "cinder-quobyte-dd8a0805-4288-4173-b96b-9ed8a94e69e7" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 08:59:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Lock "cinder-quobyte-dd8a0805-4288-4173-b96b-9ed8a94e69e7" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 08:59:25 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bbc098-9a77-42db-ae7e-5f8f143ef249]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 08:59:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:25 devstack sudo[88623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7
Jul 09 08:59:25 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:26 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7" returned: 0 in 0.856s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:26 devstack sudo[88628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7
Jul 09 08:59:26 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:26 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dd8a0805-4288-4173-b96b-9ed8a94e69e7" returned: 0 in 0.807s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Lock "cinder-quobyte-dd8a0805-4288-4173-b96b-9ed8a94e69e7" released by "delete_volume" :: held 1.732s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 08:59:26 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Created reservations ['c03b2c75-5fea-4150-87b4-0a45e5603504', 'f21f9424-f9e6-4bec-8648-46a871ed3656', '4d9c906d-b9f0-4c37-94d4-d2ad325b8d8c', 'b1dac06d-0143-46ce-887a-27fe320adc03'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 08:59:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:59:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:59:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:27 devstack sudo[88631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:59:27 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Acquiring lock "cinder-c74a5833-8e53-452c-ab19-9d6faf075066-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 08:59:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Lock "cinder-c74a5833-8e53-452c-ab19-9d6faf075066-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 08:59:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Acquiring lock "cinder-quobyte-c74a5833-8e53-452c-ab19-9d6faf075066" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 08:59:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Lock "cinder-quobyte-c74a5833-8e53-452c-ab19-9d6faf075066" acquired by "delete_volume" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 08:59:27 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[76db72f2-b6d1-4d31-8156-92f179bc398b]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 08:59:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c74a5833-8e53-452c-ab19-9d6faf075066 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:27 devstack sudo[88633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c74a5833-8e53-452c-ab19-9d6faf075066
Jul 09 08:59:27 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:28 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.984s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:28 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:59:28 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Deleted volume successfully.
Jul 09 08:59:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7fd75603-2812-429e-9dd2-e35e2674ae0a tempest-ServersNegativeTestJSON-200532840 None] Lock "cinder-dd8a0805-4288-4173-b96b-9ed8a94e69e7-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 08:59:28 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c74a5833-8e53-452c-ab19-9d6faf075066" returned: 0 in 0.864s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c74a5833-8e53-452c-ab19-9d6faf075066 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:28 devstack sudo[88640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c74a5833-8e53-452c-ab19-9d6faf075066
Jul 09 08:59:28 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:29 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c74a5833-8e53-452c-ab19-9d6faf075066" returned: 0 in 0.866s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Lock "cinder-quobyte-c74a5833-8e53-452c-ab19-9d6faf075066" released by "delete_volume" :: held 1.786s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 08:59:29 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Created reservations ['6aa31b36-763b-4d9f-821a-8840b6dfe163', 'a1ceb3b2-0d0b-4a1b-b522-66bebe879cda', 'fa343ec1-3538-4f0b-86b5-8d1c2831ccb0', '986572e8-70dd-4e6a-9e40-1e8dc65bef09'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 08:59:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:59:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:59:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:29 devstack sudo[88643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:59:29 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:30 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.940s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:30 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:59:30 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Deleted volume successfully.
Jul 09 08:59:30 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-62704128-d048-4aec-a2bd-252f03c46bcd tempest-ServersNegativeTestJSON-200532840 None] Lock "cinder-c74a5833-8e53-452c-ab19-9d6faf075066-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 08:59:39 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=70,cinder:UPDATE=77,cinder:INSERT=22,cinder:DELETE=2 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 08:59:40 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=83,cinder:SELECT=67,cinder:DELETE=7,cinder:INSERT=11 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Flow 'volume_create_manager' (5e128a2f-d257-4fce-8f1d-2e2bba99d126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fdca167-af2e-4f4e-9e44-aca5ec6c2bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fdca167-af2e-4f4e-9e44-aca5ec6c2bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T06:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1627845854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c8a967-8e63-4440-bc72-46eef8ff6493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b030d4b69f42de81199d6324efd21b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:59:47Z,use_quota=True,user_id='a8dc7de07c094c92b3418b9d54d2bc14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61aa286c-0698-4117-b18b-ebd9a0814190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61aa286c-0698-4117-b18b-ebd9a0814190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78abf43-edd0-4eab-85bd-1e8be6201ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78abf43-edd0-4eab-85bd-1e8be6201ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64c8a967-8e63-4440-bc72-46eef8ff6493', 'volume_name': 'volume-64c8a967-8e63-4440-bc72-46eef8ff6493', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bcb8819-d928-467d-8ba4-72173959dbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bcb8819-d928-467d-8ba4-72173959dbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c26198a5-5009-4d50-b899-e676f0b98de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:47 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Volume 64c8a967-8e63-4440-bc72-46eef8ff6493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64c8a967-8e63-4440-bc72-46eef8ff6493', 'volume_size': 1}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T06:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1627845854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c8a967-8e63-4440-bc72-46eef8ff6493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b030d4b69f42de81199d6324efd21b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:59:47Z,use_quota=True,user_id='a8dc7de07c094c92b3418b9d54d2bc14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Creating volume 64c8a967-8e63-4440-bc72-46eef8ff6493 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 08:59:47 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 08:59:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-64c8a967-8e63-4440-bc72-46eef8ff6493 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:47 devstack sudo[88691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-64c8a967-8e63-4440-bc72-46eef8ff6493 1073741824
Jul 09 08:59:47 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:49 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-64c8a967-8e63-4440-bc72-46eef8ff6493 1073741824" returned: 0 in 1.411s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-64c8a967-8e63-4440-bc72-46eef8ff6493 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:49 devstack sudo[88702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-64c8a967-8e63-4440-bc72-46eef8ff6493
Jul 09 08:59:49 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:49 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-64c8a967-8e63-4440-bc72-46eef8ff6493" returned: 0 in 0.752s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] <== create_volume: return (2212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 08:59:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.215s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c26198a5-5009-4d50-b899-e676f0b98de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64c8a967-8e63-4440-bc72-46eef8ff6493', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b430c7-1f8b-46f2-a353-f68c9e8f2ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:49 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Volume volume-64c8a967-8e63-4440-bc72-46eef8ff6493 (64c8a967-8e63-4440-bc72-46eef8ff6493): created successfully
Jul 09 08:59:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b430c7-1f8b-46f2-a353-f68c9e8f2ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Flow 'volume_create_manager' (5e128a2f-d257-4fce-8f1d-2e2bba99d126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:59:49 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d5e8f4ba-3d5e-4a4a-b9d2-66153c5d5177 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Created volume successfully.
Jul 09 08:59:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Acquiring lock "cinder-64c8a967-8e63-4440-bc72-46eef8ff6493-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 08:59:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Lock "cinder-64c8a967-8e63-4440-bc72-46eef8ff6493-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 08:59:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Acquiring lock "cinder-quobyte-64c8a967-8e63-4440-bc72-46eef8ff6493" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 08:59:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Lock "cinder-quobyte-64c8a967-8e63-4440-bc72-46eef8ff6493" acquired by "delete_volume" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 08:59:50 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e491970-8742-45d6-8efc-af025e2e77fa]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 08:59:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-64c8a967-8e63-4440-bc72-46eef8ff6493 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:51 devstack sudo[88709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-64c8a967-8e63-4440-bc72-46eef8ff6493
Jul 09 08:59:51 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:51 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-64c8a967-8e63-4440-bc72-46eef8ff6493" returned: 0 in 0.885s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-64c8a967-8e63-4440-bc72-46eef8ff6493 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:51 devstack sudo[88716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-64c8a967-8e63-4440-bc72-46eef8ff6493
Jul 09 08:59:51 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:52 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-64c8a967-8e63-4440-bc72-46eef8ff6493" returned: 0 in 0.694s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:52 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Lock "cinder-quobyte-64c8a967-8e63-4440-bc72-46eef8ff6493" released by "delete_volume" :: held 1.639s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 08:59:52 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Created reservations ['8d51dd6c-4709-4b23-852b-669e38a76dbe', '501ec333-353c-4226-99b8-3209d8cd5a65', '49b2e37f-db53-40a3-ae0b-4eb19a64693d', 'a037688a-7e4c-4f05-9b0c-2b0fb237024f'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 08:59:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:59:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:59:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:52 devstack sudo[88720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:59:52 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:53 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.815s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:53 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:59:53 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Deleted volume successfully.
Jul 09 08:59:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81b37054-2ed8-4d70-bb86-01dabd3b36ef tempest-VolumeQuotasAdminTestJSON-2114422613 None] Lock "cinder-64c8a967-8e63-4440-bc72-46eef8ff6493-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 08:59:53 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 08:59:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Flow 'volume_create_manager' (21f0d6d8-8b34-471b-8c97-bcedc59c17f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:59:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2949136f-4015-4ecd-a595-085fb18bea8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2949136f-4015-4ecd-a595-085fb18bea8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T06:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-593389953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d7d223-701d-45ed-a9d5-766746acdd0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b030d4b69f42de81199d6324efd21b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:59:54Z,use_quota=True,user_id='a8dc7de07c094c92b3418b9d54d2bc14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0d9024-663d-4b53-91b3-c85ca8be948b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0d9024-663d-4b53-91b3-c85ca8be948b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a76e786-fb1e-40d7-a1ae-59df52c72d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a76e786-fb1e-40d7-a1ae-59df52c72d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d7d223-701d-45ed-a9d5-766746acdd0e', 'volume_name': 'volume-c1d7d223-701d-45ed-a9d5-766746acdd0e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14501245-eee3-4250-a301-1cc1087e9c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14501245-eee3-4250-a301-1cc1087e9c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333eda7b-9dc7-4b31-bd76-33f6a07e9e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:54 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Volume c1d7d223-701d-45ed-a9d5-766746acdd0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d7d223-701d-45ed-a9d5-766746acdd0e', 'volume_size': 1}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T06:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-593389953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d7d223-701d-45ed-a9d5-766746acdd0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b030d4b69f42de81199d6324efd21b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T06:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T06:59:54Z,use_quota=True,user_id='a8dc7de07c094c92b3418b9d54d2bc14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Creating volume c1d7d223-701d-45ed-a9d5-766746acdd0e {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 08:59:54 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c1d7d223-701d-45ed-a9d5-766746acdd0e 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:54 devstack sudo[88723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c1d7d223-701d-45ed-a9d5-766746acdd0e 1073741824
Jul 09 08:59:54 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:54 devstack sudo[88725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 08:59:54 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:55 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.162s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 08:59:55 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 08:59:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 8 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 08:59:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 08:59:55 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c1d7d223-701d-45ed-a9d5-766746acdd0e 1073741824" returned: 0 in 1.480s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c1d7d223-701d-45ed-a9d5-766746acdd0e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:55 devstack sudo[88745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c1d7d223-701d-45ed-a9d5-766746acdd0e
Jul 09 08:59:55 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 08:59:56 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root
Jul 09 08:59:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c1d7d223-701d-45ed-a9d5-766746acdd0e" returned: 0 in 0.886s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 08:59:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] <== create_volume: return (2416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 08:59:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.419s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 08:59:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333eda7b-9dc7-4b31-bd76-33f6a07e9e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d7d223-701d-45ed-a9d5-766746acdd0e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59835f5c-9054-44df-a4d1-78630ee39255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 08:59:56 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Volume volume-c1d7d223-701d-45ed-a9d5-766746acdd0e (c1d7d223-701d-45ed-a9d5-766746acdd0e): created successfully
Jul 09 08:59:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59835f5c-9054-44df-a4d1-78630ee39255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 08:59:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Flow 'volume_create_manager' (21f0d6d8-8b34-471b-8c97-bcedc59c17f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 08:59:56 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-053b30d0-0c6a-4312-ac79-b8b3231e30d3 tempest-VolumeQuotasAdminTestJSON-2114422613 None] Created volume successfully.
Jul 09 08:59:58 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-338094b6-17d3-4fe2-b7f8-3a9d32861dd8 tempest-VolumeQuotasAdminTestJSON-957306080 None] Transfer volume completed successfully.
Jul 09 08:59:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Acquiring lock "cinder-c1d7d223-701d-45ed-a9d5-766746acdd0e-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 08:59:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Lock "cinder-c1d7d223-701d-45ed-a9d5-766746acdd0e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 08:59:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Acquiring lock "cinder-quobyte-c1d7d223-701d-45ed-a9d5-766746acdd0e" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 08:59:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Lock "cinder-quobyte-c1d7d223-701d-45ed-a9d5-766746acdd0e" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 08:59:59 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71ae8cb-d5ba-42e3-bb8e-43107e9e16f3]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 08:59:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c1d7d223-701d-45ed-a9d5-766746acdd0e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 08:59:59 devstack sudo[88773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c1d7d223-701d-45ed-a9d5-766746acdd0e
Jul 09 08:59:59 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:00 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c1d7d223-701d-45ed-a9d5-766746acdd0e" returned: 0 in 1.221s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c1d7d223-701d-45ed-a9d5-766746acdd0e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:00 devstack sudo[88793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c1d7d223-701d-45ed-a9d5-766746acdd0e
Jul 09 09:00:00 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:01 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c1d7d223-701d-45ed-a9d5-766746acdd0e" returned: 0 in 0.805s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Lock "cinder-quobyte-c1d7d223-701d-45ed-a9d5-766746acdd0e" released by "delete_volume" :: held 2.111s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:00:01 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Created reservations ['86f0a8a6-684c-44b8-91e0-c73ca3eaa558', 'd834508e-b165-43d3-a5b3-a48fc9f93aa8', '6de406c9-18be-42bb-a05e-dafe0c6a61ba', '00d4f821-2e56-45e3-aa1d-c5801566ed94'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:00:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:00:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:00:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:01 devstack sudo[88797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:00:01 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:02 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.007s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:02 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:00:02 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Deleted volume successfully.
Jul 09 09:00:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-833fa84f-d7e8-489c-bc31-a609b77d2187 tempest-VolumeQuotasAdminTestJSON-1088774396 None] Lock "cinder-c1d7d223-701d-45ed-a9d5-766746acdd0e-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:00:11 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=25,cinder:SELECT=14,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:00:12 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=16,cinder:INSERT=3,cinder:UPDATE=20,cinder:DELETE=3 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:00:14 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:00:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Flow 'volume_create_manager' (630b6936-73e5-4432-8422-5409d46f108b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:00:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4581140d-2df4-490f-af9a-d37167eb64e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4581140d-2df4-490f-af9a-d37167eb64e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-66139238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f6642e-3e76-416c-a57e-b151606efed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ed30f2c1b04dad9d3db51d49e6250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:00:15Z,use_quota=True,user_id='8cdf6fef342d490097e4dd87b0e6ac01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c4a068-6aa6-4507-a813-85f0f7362c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c4a068-6aa6-4507-a813-85f0f7362c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0c18f3-a04b-4787-9acb-9b2a7da805ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0c18f3-a04b-4787-9acb-9b2a7da805ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f6642e-3e76-416c-a57e-b151606efed3', 'volume_name': 'volume-97f6642e-3e76-416c-a57e-b151606efed3', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b0029e-de90-4a8f-a12c-9b587e08ec88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b0029e-de90-4a8f-a12c-9b587e08ec88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e5e450-87ba-4cb2-b68a-4413d0405aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:15 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Volume 97f6642e-3e76-416c-a57e-b151606efed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f6642e-3e76-416c-a57e-b151606efed3', 'volume_size': 1}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-66139238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f6642e-3e76-416c-a57e-b151606efed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ed30f2c1b04dad9d3db51d49e6250a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:00:15Z,use_quota=True,user_id='8cdf6fef342d490097e4dd87b0e6ac01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Creating volume 97f6642e-3e76-416c-a57e-b151606efed3 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:00:15 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:00:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-97f6642e-3e76-416c-a57e-b151606efed3 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:15 devstack sudo[89028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-97f6642e-3e76-416c-a57e-b151606efed3 1073741824
Jul 09 09:00:15 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:16 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:00:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Flow 'volume_create_manager' (6f22d2a3-de42-4072-a006-b97957e96085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:00:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69cd8b5b-a61b-44e2-887f-1087c16dfb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69cd8b5b-a61b-44e2-887f-1087c16dfb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1545898521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5d4f20e2aa44528618839a71907360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:00:16Z,use_quota=True,user_id='3ef4fce7a66a41cb8c2b6bb9240e52ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8d5e6d-d015-4bfd-ba5c-5382376237fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa8d5e6d-d015-4bfd-ba5c-5382376237fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b164c9-b4bd-4d4f-a3e3-bf4e7187ec6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b164c9-b4bd-4d4f-a3e3-bf4e7187ec6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de', 'volume_name': 'volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8b6a2e-eca6-4e8a-a714-aadea0d912a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8b6a2e-eca6-4e8a-a714-aadea0d912a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd05aef-19a9-4eee-808d-614fd5ec9ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:16 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Volume 359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de', 'volume_size': 1}
Jul 09 09:00:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:17 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-97f6642e-3e76-416c-a57e-b151606efed3 1073741824" returned: 0 in 1.892s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-97f6642e-3e76-416c-a57e-b151606efed3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:17 devstack sudo[89046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-97f6642e-3e76-416c-a57e-b151606efed3
Jul 09 09:00:17 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:18 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-97f6642e-3e76-416c-a57e-b151606efed3" returned: 0 in 1.446s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] <== create_volume: return (3462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.465s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.225s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1545898521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a5d4f20e2aa44528618839a71907360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:00:16Z,use_quota=True,user_id='3ef4fce7a66a41cb8c2b6bb9240e52ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Creating volume 359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:00:18 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:18 devstack sudo[89050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de 1073741824
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e5e450-87ba-4cb2-b68a-4413d0405aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f6642e-3e76-416c-a57e-b151606efed3', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:18 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5842298-558f-467e-bd81-6fe0ce36a97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:18 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Volume volume-97f6642e-3e76-416c-a57e-b151606efed3 (97f6642e-3e76-416c-a57e-b151606efed3): created successfully
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5842298-558f-467e-bd81-6fe0ce36a97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Flow 'volume_create_manager' (630b6936-73e5-4432-8422-5409d46f108b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:00:18 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2b87d18d-2932-433d-9c13-f98901f9806c tempest-VolumesAdminNegativeTest-1941197475 None] Created volume successfully.
Jul 09 09:00:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Acquiring lock "cinder-97f6642e-3e76-416c-a57e-b151606efed3-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:00:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Lock "cinder-97f6642e-3e76-416c-a57e-b151606efed3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:00:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Acquiring lock "cinder-quobyte-97f6642e-3e76-416c-a57e-b151606efed3" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:00:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Lock "cinder-quobyte-97f6642e-3e76-416c-a57e-b151606efed3" acquired by "delete_volume" :: waited 0.038s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:00:20 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea34f22-fd74-4f4c-8496-2242b299f81d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:00:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-97f6642e-3e76-416c-a57e-b151606efed3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:20 devstack sudo[89063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-97f6642e-3e76-416c-a57e-b151606efed3
Jul 09 09:00:20 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:20 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de 1073741824" returned: 0 in 2.040s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:20 devstack sudo[89065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de
Jul 09 09:00:20 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:21 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de" returned: 0 in 0.865s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] <== create_volume: return (2965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:00:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.972s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd05aef-19a9-4eee-808d-614fd5ec9ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e297181-e563-44aa-872e-c39173b5315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:21 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Volume volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de (359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de): created successfully
Jul 09 09:00:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e297181-e563-44aa-872e-c39173b5315e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Flow 'volume_create_manager' (6f22d2a3-de42-4072-a006-b97957e96085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:00:21 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-04bcb085-e60a-474b-b866-74ac1a636450 tempest-VolumesServicesTestJSON-900803296 None] Created volume successfully.
Jul 09 09:00:22 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-97f6642e-3e76-416c-a57e-b151606efed3" returned: 0 in 1.536s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-97f6642e-3e76-416c-a57e-b151606efed3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:22 devstack sudo[89078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-97f6642e-3e76-416c-a57e-b151606efed3
Jul 09 09:00:22 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:22 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-97f6642e-3e76-416c-a57e-b151606efed3" returned: 0 in 0.768s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Lock "cinder-quobyte-97f6642e-3e76-416c-a57e-b151606efed3" released by "delete_volume" :: held 2.405s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:00:23 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Created reservations ['59e34d54-45b3-420d-ad56-681ad728c2ac', 'a34e759b-eafb-4e4e-98ce-777d8416ebfb', '0b5f2224-4985-44dd-bd0d-f1826376d04b', 'c28a293b-1d9c-4bfc-9d90-d9e419e93070'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:00:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:00:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:00:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:23 devstack sudo[89084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:00:23 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Acquiring lock "cinder-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:00:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Lock "cinder-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:00:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Acquiring lock "cinder-quobyte-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:00:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Lock "cinder-quobyte-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de" acquired by "delete_volume" :: waited 0.032s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:00:24 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b472f6-de90-43c1-8722-bd7b1f2bb68e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:00:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:24 devstack sudo[89132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de
Jul 09 09:00:24 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:25 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.897s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:25 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:00:25 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Deleted volume successfully.
Jul 09 09:00:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2242f058-c002-446d-8ed5-03061bb0fd42 tempest-VolumesAdminNegativeTest-1941197475 None] Lock "cinder-97f6642e-3e76-416c-a57e-b151606efed3-delete_volume" released by "delete_volume" :: held 4.786s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:00:25 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de" returned: 0 in 1.684s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:25 devstack sudo[89191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de
Jul 09 09:00:25 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:26 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de" returned: 0 in 0.755s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Lock "cinder-quobyte-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de" released by "delete_volume" :: held 2.576s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:00:26 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Created reservations ['063e2eb8-e757-4b3e-b80d-e9f98b086182', 'd75a996a-e8dc-4ec9-841e-9f06beb6e546', 'e92148cb-22b9-483a-9f73-976890bc3660', '555da87d-30b6-4b57-8dd2-3a8c38b1efbe'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:00:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:00:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:00:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:26 devstack sudo[89224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:00:26 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:28 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.467s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:28 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:00:28 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Deleted volume successfully.
Jul 09 09:00:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dda4eaed-a874-4a2c-9702-bd94574f8cca tempest-VolumesServicesTestJSON-900803296 None] Lock "cinder-359d0bcc-ec6a-4c10-b5c4-ae36b6fa93de-delete_volume" released by "delete_volume" :: held 4.629s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Flow 'volume_create_manager' (5589d3b7-ba25-4a97-a718-de09468c4d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bb8b4f-5694-4056-bb3e-b4f8c2011227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bb8b4f-5694-4056-bb3e-b4f8c2011227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1267142634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9fa109-ea20-400e-a69a-5c4fedbd9deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2f71c7a5f04591a5c5c0434b8315c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:00:31Z,use_quota=True,user_id='d2c2a0673838453dac61dd59aedaef35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd063d3-2f4b-4d5f-974d-3ef2aea24468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd063d3-2f4b-4d5f-974d-3ef2aea24468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a7af51-8097-4eb2-93c5-094dd0b1ae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a7af51-8097-4eb2-93c5-094dd0b1ae91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf9fa109-ea20-400e-a69a-5c4fedbd9deb', 'volume_name': 'volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e12b03-4267-4116-945c-c3fc567811ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e12b03-4267-4116-945c-c3fc567811ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54c215d-3130-43c1-aa26-b26c6c5f66cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:31 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Volume bf9fa109-ea20-400e-a69a-5c4fedbd9deb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb', 'volume_size': 1}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1267142634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf9fa109-ea20-400e-a69a-5c4fedbd9deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a2f71c7a5f04591a5c5c0434b8315c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:00:31Z,use_quota=True,user_id='d2c2a0673838453dac61dd59aedaef35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Creating volume bf9fa109-ea20-400e-a69a-5c4fedbd9deb {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:00:31 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:00:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:31 devstack sudo[89239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb 1073741824
Jul 09 09:00:31 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:33 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb 1073741824" returned: 0 in 2.082s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:33 devstack sudo[89248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb
Jul 09 09:00:33 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:35 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb" returned: 0 in 1.817s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] <== create_volume: return (4018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:00:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.024s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54c215d-3130-43c1-aa26-b26c6c5f66cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cd3ad6-ab0b-4566-b7e3-05af62a770d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:35 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Volume volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb (bf9fa109-ea20-400e-a69a-5c4fedbd9deb): created successfully
Jul 09 09:00:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cd3ad6-ab0b-4566-b7e3-05af62a770d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Flow 'volume_create_manager' (5589d3b7-ba25-4a97-a718-de09468c4d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:00:35 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b7737a30-25ef-4462-b0e3-3e252f7fe37c tempest-ServerRescueNegativeTestJSON-1963862642 None] Created volume successfully.
Jul 09 09:00:45 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=28,cinder:SELECT=18,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:00:45 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=14,cinder:UPDATE=22,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Flow 'volume_create_manager' (95e54d42-1797-4e57-b58f-5954b7c06dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29594cbe-15ca-4d5a-959f-b36b2d99bd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29594cbe-15ca-4d5a-959f-b36b2d99bd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1436443581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d161e48d-826b-4b0c-b9ac-4784624b1ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be1c29114f24209bd99d495f037f47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:00:46Z,use_quota=True,user_id='c55e96b5a8bd4df8a3a8fbca9cdec480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e9ffce-910d-4335-8271-6aaf96f27242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e9ffce-910d-4335-8271-6aaf96f27242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2440782c-e639-47ac-8268-8c9bc2d4af68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2440782c-e639-47ac-8268-8c9bc2d4af68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd161e48d-826b-4b0c-b9ac-4784624b1ad7', 'volume_name': 'volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6256ff2b-c3e3-46f4-b425-3332c77e742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6256ff2b-c3e3-46f4-b425-3332c77e742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a0a901-27d0-487a-8621-db7f1fb45b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:46 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Volume d161e48d-826b-4b0c-b9ac-4784624b1ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7', 'volume_size': 1}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1436443581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d161e48d-826b-4b0c-b9ac-4784624b1ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be1c29114f24209bd99d495f037f47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:00:46Z,use_quota=True,user_id='c55e96b5a8bd4df8a3a8fbca9cdec480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Creating volume d161e48d-826b-4b0c-b9ac-4784624b1ad7 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:00:46 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:00:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:46 devstack sudo[89314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7 1073741824
Jul 09 09:00:46 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:47 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7 1073741824" returned: 0 in 1.017s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:47 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7
Jul 09 09:00:47 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:48 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7" returned: 0 in 0.694s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:00:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a0a901-27d0-487a-8621-db7f1fb45b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f26b38b-761b-48b3-9cb8-f0f4c0a0ed81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:48 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Volume volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7 (d161e48d-826b-4b0c-b9ac-4784624b1ad7): created successfully
Jul 09 09:00:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f26b38b-761b-48b3-9cb8-f0f4c0a0ed81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Flow 'volume_create_manager' (95e54d42-1797-4e57-b58f-5954b7c06dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:00:48 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-65879dac-02f9-412e-a1d7-58680a4f439e tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Created volume successfully.
Jul 09 09:00:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Creating offline snapshot ff97d43a-a053-4b90-bf92-3bde0a2a4236 of volume d161e48d-826b-4b0c-b9ac-4784624b1ad7 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:00:48 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4c27dd-bba9-4a6d-849c-63772e3e0130]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:00:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:49 devstack sudo[89351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7
Jul 09 09:00:49 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:49 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7" returned: 0 in 1.003s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:49 devstack sudo[89356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236 1G
Jul 09 09:00:49 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:51 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236 1G" returned: 0 in 1.652s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:51 devstack sudo[89362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236
Jul 09 09:00:51 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:53 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236" returned: 0 in 1.560s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:53 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236 is being set with open permissions: ugo+rw
Jul 09 09:00:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:53 devstack sudo[89417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236
Jul 09 09:00:53 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:00:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:00:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:00:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:54 devstack sudo[89436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:00:54 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:54 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236" returned: 0 in 1.166s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:54 devstack sudo[89439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.info
Jul 09 09:00:54 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:55 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.029s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:00:55 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:00:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 8 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:00:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:00:55 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.info" returned: 0 in 1.101s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:55 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.info is being set with open permissions: ugo+rw
Jul 09 09:00:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:55 devstack sudo[89445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.info
Jul 09 09:00:55 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Acquiring lock "cinder-bf9fa109-ea20-400e-a69a-5c4fedbd9deb-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:00:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Lock "cinder-bf9fa109-ea20-400e-a69a-5c4fedbd9deb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:00:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Acquiring lock "cinder-quobyte-bf9fa109-ea20-400e-a69a-5c4fedbd9deb" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:00:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Lock "cinder-quobyte-bf9fa109-ea20-400e-a69a-5c4fedbd9deb" acquired by "delete_volume" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:00:55 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcb48ae-c5cf-4c59-bc11-7b032f27c845]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:00:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:56 devstack sudo[89447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb
Jul 09 09:00:56 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:56 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.info" returned: 0 in 1.065s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.714s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:56 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a16780fa-476d-4d07-8556-8703885ae3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Create snapshot completed successfully
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:00:57 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Flow 'volume_create_manager' (a8274f03-ddd4-4a46-9c88-889ff8dd4521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9556e683-b006-47f5-b725-5626134d6e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb" returned: 0 in 1.334s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9556e683-b006-47f5-b725-5626134d6e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2124171654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a025178-9ed0-412f-8087-ada32a014271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e0427d338c43418a8c9c4bf2f8bf39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:00:57Z,use_quota=True,user_id='e6b82d1aeb064ff08197e9f231fffa8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8cbeb03-2c51-4c26-aa94-5d7c6315a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:57 devstack sudo[89455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb
Jul 09 09:00:57 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8cbeb03-2c51-4c26-aa94-5d7c6315a994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e6f078-b665-4bb2-840b-68180a428229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e6f078-b665-4bb2-840b-68180a428229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a025178-9ed0-412f-8087-ada32a014271', 'volume_name': 'volume-0a025178-9ed0-412f-8087-ada32a014271', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa96b4ba-6596-4365-8579-8728c1d60104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa96b4ba-6596-4365-8579-8728c1d60104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f7827f-329e-4471-913f-36b3529970d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:00:57 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Volume 0a025178-9ed0-412f-8087-ada32a014271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a025178-9ed0-412f-8087-ada32a014271', 'volume_size': 1}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2124171654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a025178-9ed0-412f-8087-ada32a014271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e0427d338c43418a8c9c4bf2f8bf39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:00:57Z,use_quota=True,user_id='e6b82d1aeb064ff08197e9f231fffa8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Creating volume 0a025178-9ed0-412f-8087-ada32a014271 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:00:57 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:00:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0a025178-9ed0-412f-8087-ada32a014271 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:57 devstack sudo[89457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0a025178-9ed0-412f-8087-ada32a014271 1073741824
Jul 09 09:00:57 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Acquiring lock "cinder-ff97d43a-a053-4b90-bf92-3bde0a2a4236-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "cinder-ff97d43a-a053-4b90-bf92-3bde0a2a4236-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Acquiring lock "cinder-quobyte-d161e48d-826b-4b0c-b9ac-4784624b1ad7" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "cinder-quobyte-d161e48d-826b-4b0c-b9ac-4784624b1ad7" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Acquiring lock "cinder-quobyte-ff97d43a-a053-4b90-bf92-3bde0a2a4236" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "cinder-quobyte-ff97d43a-a053-4b90-bf92-3bde0a2a4236" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Deleting offline snapshot ff97d43a-a053-4b90-bf92-3bde0a2a4236 of volume d161e48d-826b-4b0c-b9ac-4784624b1ad7 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] snapshot_file for this snap is: volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4724e50a-7e8b-4810-847c-6b8c27dd2232]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:58 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf9fa109-ea20-400e-a69a-5c4fedbd9deb" returned: 0 in 1.490s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Lock "cinder-quobyte-bf9fa109-ea20-400e-a69a-5c4fedbd9deb" released by "delete_volume" :: held 2.900s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:00:58 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0a025178-9ed0-412f-8087-ada32a014271 1073741824" returned: 0 in 1.433s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Created reservations ['5417d695-27ca-4dfb-9d16-78a37b8b0688', 'e8d0e8db-bb9b-425d-8aec-2eb17a16d1b9', '871955b9-54a2-41cc-80e0-b66942436db5', '0ce97c93-1211-4339-82e8-d81df26fca79'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0a025178-9ed0-412f-8087-ada32a014271 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:58 devstack sudo[89466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0a025178-9ed0-412f-8087-ada32a014271
Jul 09 09:00:58 devstack sudo[89465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236
Jul 09 09:00:58 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:58 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:00:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:00:59 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:00:59 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:00 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0a025178-9ed0-412f-8087-ada32a014271" returned: 0 in 1.248s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] <== create_volume: return (2766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:01:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.775s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:01:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1f7827f-329e-4471-913f-36b3529970d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a025178-9ed0-412f-8087-ada32a014271', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9390ea-86fe-4153-9084-9c26b41f06c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:00 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Volume volume-0a025178-9ed0-412f-8087-ada32a014271 (0a025178-9ed0-412f-8087-ada32a014271): created successfully
Jul 09 09:01:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9390ea-86fe-4153-9084-9c26b41f06c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Flow 'volume_create_manager' (a8274f03-ddd4-4a46-9c88-889ff8dd4521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:01:00 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-40cfa2cb-9478-4765-be1f-da944e23b397 tempest-AttachVolumeShelveTestJSON-859210059 None] Created volume successfully.
Jul 09 09:01:00 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236" returned: 0 in 1.707s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:01:00 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[230c7165-bd91-48cd-99d9-83d9a86e1ffd]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:01:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:00 devstack sudo[89477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7
Jul 09 09:01:00 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:00 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.913s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:00 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:01:00 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Deleted volume successfully.
Jul 09 09:01:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-98319dfa-b889-4321-8824-273cecc906e8 tempest-ServerRescueNegativeTestJSON-1963862642 None] Lock "cinder-bf9fa109-ea20-400e-a69a-5c4fedbd9deb-delete_volume" released by "delete_volume" :: held 5.227s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:01:02 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7" returned: 0 in 1.925s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:02 devstack sudo[89515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236
Jul 09 09:01:02 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:03 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236" returned: 0 in 1.507s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:03 devstack sudo[89525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236
Jul 09 09:01:03 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:04 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7.ff97d43a-a053-4b90-bf92-3bde0a2a4236" returned: 0 in 0.782s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "cinder-quobyte-ff97d43a-a053-4b90-bf92-3bde0a2a4236" released by "_delete_snapshot" :: held 6.098s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:01:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "cinder-quobyte-d161e48d-826b-4b0c-b9ac-4784624b1ad7" released by "delete_snapshot" :: held 6.152s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:01:04 devstack cinder-volume[87009]: WARNING cinder.quota [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:01:04 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Created reservations ['ed3c7bf3-50c9-4eb1-bf5c-f8ca2ec439f4', '21db754f-fb31-4362-bc24-b16683a0c488', '1d420ae7-3770-465e-983c-d480d7ad231a', 'ac40c375-5f36-4ed6-b282-5318f213f927'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:01:04 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Delete snapshot completed successfully.
Jul 09 09:01:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a4cabfe-a331-4dec-ae45-58e5b174e014 tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "cinder-ff97d43a-a053-4b90-bf92-3bde0a2a4236-delete_snapshot" released by "delete_snapshot" :: held 6.388s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:01:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Acquiring lock "cinder-d161e48d-826b-4b0c-b9ac-4784624b1ad7-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:01:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "cinder-d161e48d-826b-4b0c-b9ac-4784624b1ad7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:01:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Acquiring lock "cinder-quobyte-d161e48d-826b-4b0c-b9ac-4784624b1ad7" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:01:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "cinder-quobyte-d161e48d-826b-4b0c-b9ac-4784624b1ad7" acquired by "delete_volume" :: waited 0.037s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:01:05 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4d34fa-65c0-4fc6-bb43-3af7d79c421a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:01:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:05 devstack sudo[89534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7
Jul 09 09:01:05 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:06 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7" returned: 0 in 1.000s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:06 devstack sudo[89540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7
Jul 09 09:01:06 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:07 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d161e48d-826b-4b0c-b9ac-4784624b1ad7" returned: 0 in 1.206s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "cinder-quobyte-d161e48d-826b-4b0c-b9ac-4784624b1ad7" released by "delete_volume" :: held 2.312s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:01:07 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Created reservations ['20ee8c90-6243-4216-89fa-7e72098d53c5', 'd596ffa0-fb1c-4a5d-bc17-f9176934e74e', '7af4de6e-ec2b-4d7e-a91e-fb64a89ef1a0', 'de33d396-8fd1-4a48-8cb0-5f8cdd5df666'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:01:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:01:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:01:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:01:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:01:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:01:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:07 devstack sudo[89561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:01:07 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:08 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.694s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:08 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:01:08 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Deleted volume successfully.
Jul 09 09:01:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a599b366-d968-43d8-8212-c5865605cb7d tempest-VolumeSnapshotQuotasNegativeTestJSON-1278950103 None] Lock "cinder-d161e48d-826b-4b0c-b9ac-4784624b1ad7-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:01:17 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=29,cinder:UPDATE=32,cinder:DELETE=1,cinder:INSERT=6 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:01:18 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=17,cinder:UPDATE=26,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:01:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-17ab87c6-f4d2-4f7c-96ac-6090fbdbfb7c req-d85a4724-22a4-4500-a622-a302e0728e2f tempest-AttachVolumeShelveTestJSON-859210059 None] No connector for attachment 1c0b2780-77e1-4a73-a3e7-817612f40294; skipping storage backend terminate_connection call. {{(pid=87009) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 09 09:01:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-17ab87c6-f4d2-4f7c-96ac-6090fbdbfb7c req-d85a4724-22a4-4500-a622-a302e0728e2f tempest-AttachVolumeShelveTestJSON-859210059 None] Deleting attachment 1c0b2780-77e1-4a73-a3e7-817612f40294. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Flow 'volume_create_manager' (8c8a47cd-cc10-46b9-b1af-ed1ac2a65004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3982da5-bd19-4e2f-b747-a92c52f4186b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3982da5-bd19-4e2f-b747-a92c52f4186b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1256108810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ff0218-4268-49ab-b6ac-f68af8b48a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87221563d6a84486bf2f8971fe5e06f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:01:28Z,use_quota=True,user_id='c8634eaadca343e483a6c58e281be113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60af84e0-bd0d-4dba-8d60-6a96fe7f981e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60af84e0-bd0d-4dba-8d60-6a96fe7f981e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5a0a97-afab-49d5-b62b-5d0397b00883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5a0a97-afab-49d5-b62b-5d0397b00883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ff0218-4268-49ab-b6ac-f68af8b48a0a', 'volume_name': 'volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731205fc-0332-43b5-9b2c-d2cba5c0d733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731205fc-0332-43b5-9b2c-d2cba5c0d733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5b68e6-b086-4869-9d0e-7a486d55c47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:27 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Volume 08ff0218-4268-49ab-b6ac-f68af8b48a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a', 'volume_size': 1}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1256108810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ff0218-4268-49ab-b6ac-f68af8b48a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87221563d6a84486bf2f8971fe5e06f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:01:28Z,use_quota=True,user_id='c8634eaadca343e483a6c58e281be113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Creating volume 08ff0218-4268-49ab-b6ac-f68af8b48a0a {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:01:27 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:01:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:27 devstack sudo[89658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a 1073741824
Jul 09 09:01:27 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:29 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a 1073741824" returned: 0 in 1.120s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Flow 'volume_create_manager' (b9f68c7f-b723-4402-a9db-69dd5d867eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b8b2b6-5a58-4a94-a3af-cf4a019cd809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b8b2b6-5a58-4a94-a3af-cf4a019cd809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1574090137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4469c1-233c-4d3f-ac5f-312ecec1cf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada12c27325f47b7a2c86dddc343a689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:01:29Z,use_quota=True,user_id='169f0d86c42e49e788e50a531a1f8c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b113a4-35c1-4267-9eb6-501a50018483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b113a4-35c1-4267-9eb6-501a50018483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a2a52c-d9ab-43b5-b8a6-50380524aac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a2a52c-d9ab-43b5-b8a6-50380524aac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f4469c1-233c-4d3f-ac5f-312ecec1cf81', 'volume_name': 'volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71dc11cd-4719-43cd-8dca-1fb3d5aee090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71dc11cd-4719-43cd-8dca-1fb3d5aee090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f27506d-08b6-4160-873e-3013ada12605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:29 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Volume 4f4469c1-233c-4d3f-ac5f-312ecec1cf81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81', 'volume_size': 1}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:29 devstack sudo[89667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a
Jul 09 09:01:29 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:29 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a" returned: 0 in 0.703s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.719s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1574090137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4469c1-233c-4d3f-ac5f-312ecec1cf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada12c27325f47b7a2c86dddc343a689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:01:29Z,use_quota=True,user_id='169f0d86c42e49e788e50a531a1f8c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Creating volume 4f4469c1-233c-4d3f-ac5f-312ecec1cf81 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:01:29 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:29 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81 1073741824
Jul 09 09:01:29 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5b68e6-b086-4869-9d0e-7a486d55c47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a7eeed-716a-4287-aae2-eb7ede531e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:29 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Volume volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a (08ff0218-4268-49ab-b6ac-f68af8b48a0a): created successfully
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a7eeed-716a-4287-aae2-eb7ede531e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Flow 'volume_create_manager' (8c8a47cd-cc10-46b9-b1af-ed1ac2a65004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:01:29 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-89a621b8-1bc6-4b90-b42e-69e782c61410 req-4315c74a-d452-41f8-9db0-d14bd3c4fc01 tempest-VolumesSnapshotsTestJSON-1696866611 None] Created volume successfully.
Jul 09 09:01:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:01:30 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81 1073741824" returned: 0 in 0.985s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:30 devstack sudo[89677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81
Jul 09 09:01:30 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:31 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81" returned: 0 in 0.673s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:01:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:01:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.223s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:01:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f27506d-08b6-4160-873e-3013ada12605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932cf295-0bae-40b6-acca-23439f026ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] Creating offline snapshot 62d4c4e0-e7d1-4006-8c39-7de32637c576 of volume 08ff0218-4268-49ab-b6ac-f68af8b48a0a {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:01:31 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Volume volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81 (4f4469c1-233c-4d3f-ac5f-312ecec1cf81): created successfully
Jul 09 09:01:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932cf295-0bae-40b6-acca-23439f026ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Flow 'volume_create_manager' (b9f68c7f-b723-4402-a9db-69dd5d867eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:01:31 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b553b1-7bf4-44d5-9131-2c976634f4cf]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:01:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:31 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2282a423-9b0a-44c6-b212-22006ca6f04d tempest-TaggedAttachmentsTest-879459073 None] Created volume successfully.
Jul 09 09:01:31 devstack sudo[89680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a
Jul 09 09:01:31 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:32 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a" returned: 0 in 0.848s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:32 devstack sudo[89692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576 1G
Jul 09 09:01:32 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:33 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576 1G" returned: 0 in 0.962s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:33 devstack sudo[89698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576
Jul 09 09:01:33 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:34 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576" returned: 0 in 0.892s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:34 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576 is being set with open permissions: ugo+rw
Jul 09 09:01:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:34 devstack sudo[89703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576
Jul 09 09:01:34 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:35 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576" returned: 0 in 0.721s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:35 devstack sudo[89706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.info
Jul 09 09:01:35 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:35 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.info" returned: 0 in 0.801s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:35 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.info is being set with open permissions: ugo+rw
Jul 09 09:01:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:35 devstack sudo[89709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.info
Jul 09 09:01:35 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:36 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.info" returned: 0 in 0.789s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.143s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:01:36 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-333df4e4-efe3-44a5-9567-d173b30defcd req-7312f25d-18a1-4942-b380-8ccd61e8bcb4 tempest-VolumesSnapshotsTestJSON-1696866611 None] Create snapshot completed successfully
Jul 09 09:01:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Acquiring lock "cinder-62d4c4e0-e7d1-4006-8c39-7de32637c576-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:01:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "cinder-62d4c4e0-e7d1-4006-8c39-7de32637c576-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:01:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Acquiring lock "cinder-quobyte-08ff0218-4268-49ab-b6ac-f68af8b48a0a" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:01:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "cinder-quobyte-08ff0218-4268-49ab-b6ac-f68af8b48a0a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:01:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Acquiring lock "cinder-quobyte-62d4c4e0-e7d1-4006-8c39-7de32637c576" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:01:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "cinder-quobyte-62d4c4e0-e7d1-4006-8c39-7de32637c576" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:01:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Deleting offline snapshot 62d4c4e0-e7d1-4006-8c39-7de32637c576 of volume 08ff0218-4268-49ab-b6ac-f68af8b48a0a {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:01:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] snapshot_file for this snap is: volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:01:37 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da476c7-5f55-4f38-b144-a78d4d65f6d0]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:01:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:37 devstack sudo[89714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576
Jul 09 09:01:37 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:38 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576" returned: 0 in 1.040s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:01:38 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d0f96c-47b2-4168-b930-ca12d8f6087a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:01:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:38 devstack sudo[89724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a
Jul 09 09:01:38 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:39 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a" returned: 0 in 1.272s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:39 devstack sudo[89731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576
Jul 09 09:01:39 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:41 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576" returned: 0 in 1.295s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:41 devstack sudo[89736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576
Jul 09 09:01:41 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:41 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a.62d4c4e0-e7d1-4006-8c39-7de32637c576" returned: 0 in 0.756s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "cinder-quobyte-62d4c4e0-e7d1-4006-8c39-7de32637c576" released by "_delete_snapshot" :: held 4.503s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:01:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "cinder-quobyte-08ff0218-4268-49ab-b6ac-f68af8b48a0a" released by "delete_snapshot" :: held 4.531s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:01:41 devstack cinder-volume[87009]: DEBUG cinder.quota [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Created reservations ['70b18f0d-eaf0-41ed-ba93-48cb007192cb', '235586f9-bc73-4a08-8b37-420a21ed1a5a', '46249c1d-50ee-48b4-a633-ee3cfee1e0a8', 'cb573875-55d7-42e4-8ce5-eb2fce999221'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:01:42 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Delete snapshot completed successfully.
Jul 09 09:01:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-0027c39d-d1fa-4024-b749-e9e78d3bf066 req-bbce6204-5f0b-49aa-b94f-388351395fd9 tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "cinder-62d4c4e0-e7d1-4006-8c39-7de32637c576-delete_snapshot" released by "delete_snapshot" :: held 4.691s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:01:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Acquiring lock "cinder-08ff0218-4268-49ab-b6ac-f68af8b48a0a-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:01:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "cinder-08ff0218-4268-49ab-b6ac-f68af8b48a0a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:01:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Acquiring lock "cinder-quobyte-08ff0218-4268-49ab-b6ac-f68af8b48a0a" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:01:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "cinder-quobyte-08ff0218-4268-49ab-b6ac-f68af8b48a0a" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:01:42 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c3bafc-8032-4c6a-a3fd-11b60382bb61]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:01:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:42 devstack sudo[89767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a
Jul 09 09:01:42 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:43 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a" returned: 0 in 0.885s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:43 devstack sudo[89782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a
Jul 09 09:01:43 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:44 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-08ff0218-4268-49ab-b6ac-f68af8b48a0a" returned: 0 in 1.007s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "cinder-quobyte-08ff0218-4268-49ab-b6ac-f68af8b48a0a" released by "delete_volume" :: held 1.986s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:01:44 devstack cinder-volume[87009]: DEBUG cinder.quota [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Created reservations ['6d21d2df-d2ed-4929-b80d-231d9d1dce3d', 'a82b76de-071c-482c-8093-84a493dbd7c5', '9a64a8d3-4bd0-499b-8fbe-792dc1575634', '4cbb5531-6ae5-445f-a3d4-b0f248d6d598'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:01:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:01:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:01:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:01:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:01:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:01:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:45 devstack sudo[89788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:01:45 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:45 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.861s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:45 devstack cinder-volume[87009]: DEBUG cinder.manager [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:01:45 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Deleted volume successfully.
Jul 09 09:01:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-f126ba2a-61c4-492f-a739-ab4cd050ba98 req-d4557027-4beb-4a63-9719-e3e3346f552d tempest-VolumesSnapshotsTestJSON-1696866611 None] Lock "cinder-08ff0218-4268-49ab-b6ac-f68af8b48a0a-delete_volume" released by "delete_volume" :: held 3.290s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Flow 'volume_create_manager' (74f1de4f-32fc-453b-9bba-cff0389dafb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa9f0f9-98d8-4fdc-8a77-58dc75b13bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa9f0f9-98d8-4fdc-8a77-58dc75b13bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-85948508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7314a84c-815d-497a-84c4-307700763d29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e795349d47e408d89e3cc2eb07ca5b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:01:53Z,use_quota=True,user_id='79dad4439d1b433cb1e32c2705ea0b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c41dc07-1604-46dc-bde9-d86522c79f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c41dc07-1604-46dc-bde9-d86522c79f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80abc7a0-0edd-441a-a19d-ad5c74640294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80abc7a0-0edd-441a-a19d-ad5c74640294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7314a84c-815d-497a-84c4-307700763d29', 'volume_name': 'volume-7314a84c-815d-497a-84c4-307700763d29', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2c6cf2-81da-471e-8b08-cb18a8c46c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2c6cf2-81da-471e-8b08-cb18a8c46c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cd9973-01a8-47be-8623-3292feeba893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:53 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Volume 7314a84c-815d-497a-84c4-307700763d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7314a84c-815d-497a-84c4-307700763d29', 'volume_size': 1}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-85948508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7314a84c-815d-497a-84c4-307700763d29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e795349d47e408d89e3cc2eb07ca5b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:01:53Z,use_quota=True,user_id='79dad4439d1b433cb1e32c2705ea0b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Creating volume 7314a84c-815d-497a-84c4-307700763d29 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:01:53 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:01:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7314a84c-815d-497a-84c4-307700763d29 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:53 devstack sudo[89923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7314a84c-815d-497a-84c4-307700763d29 1073741824
Jul 09 09:01:53 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:01:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:01:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:01:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:01:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:01:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:01:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:54 devstack sudo[89936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:01:54 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:54 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7314a84c-815d-497a-84c4-307700763d29 1073741824" returned: 0 in 1.513s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7314a84c-815d-497a-84c4-307700763d29 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:54 devstack sudo[89949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7314a84c-815d-497a-84c4-307700763d29
Jul 09 09:01:54 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:55 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.094s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:01:55 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:01:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 8 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:01:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:01:55 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7314a84c-815d-497a-84c4-307700763d29" returned: 0 in 0.979s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] <== create_volume: return (2590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:01:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.593s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:01:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cd9973-01a8-47be-8623-3292feeba893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7314a84c-815d-497a-84c4-307700763d29', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a673ae9-c4e0-4324-8e79-1a0858fd0ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:01:55 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Volume volume-7314a84c-815d-497a-84c4-307700763d29 (7314a84c-815d-497a-84c4-307700763d29): created successfully
Jul 09 09:01:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a673ae9-c4e0-4324-8e79-1a0858fd0ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:01:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Flow 'volume_create_manager' (74f1de4f-32fc-453b-9bba-cff0389dafb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:01:56 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-fedbbf12-afd2-4fc0-a7dd-3bf2f3070bf8 req-e203ba29-f250-43ad-9b0b-af7b864bd838 tempest-VolumesGetTestJSON-323983541 None] Created volume successfully.
Jul 09 09:01:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Acquiring lock "cinder-7314a84c-815d-497a-84c4-307700763d29-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:01:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Lock "cinder-7314a84c-815d-497a-84c4-307700763d29-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:01:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Acquiring lock "cinder-quobyte-7314a84c-815d-497a-84c4-307700763d29" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:01:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Lock "cinder-quobyte-7314a84c-815d-497a-84c4-307700763d29" acquired by "delete_volume" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:01:57 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ded800a-3924-47c1-a42b-15ab010280d9]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:01:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7314a84c-815d-497a-84c4-307700763d29 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:57 devstack sudo[89973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7314a84c-815d-497a-84c4-307700763d29
Jul 09 09:01:57 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:57 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7314a84c-815d-497a-84c4-307700763d29" returned: 0 in 0.893s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7314a84c-815d-497a-84c4-307700763d29 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:57 devstack sudo[89978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7314a84c-815d-497a-84c4-307700763d29
Jul 09 09:01:57 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:58 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7314a84c-815d-497a-84c4-307700763d29" returned: 0 in 0.643s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Lock "cinder-quobyte-7314a84c-815d-497a-84c4-307700763d29" released by "delete_volume" :: held 1.582s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:01:58 devstack cinder-volume[87009]: DEBUG cinder.quota [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Created reservations ['dd12ff48-828b-4231-908f-e1cc6943898a', '3158651a-6183-4064-8200-177571df3f65', '18a0abc2-dcb4-4c37-9dc2-5287b2bab7df', '1aeb453e-4759-41c9-883a-11190b9529ed'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:01:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:01:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:01:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:01:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:01:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:01:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:01:58 devstack sudo[89983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:01:58 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:01:59 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root
Jul 09 09:01:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.690s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:01:59 devstack cinder-volume[87009]: DEBUG cinder.manager [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:01:59 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Deleted volume successfully.
Jul 09 09:01:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-54de2872-d111-40f3-96d3-afb66013a52c req-ddb1621a-a0ed-458b-989d-475b2de847f4 tempest-VolumesGetTestJSON-323983541 None] Lock "cinder-7314a84c-815d-497a-84c4-307700763d29-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4506fb02-6688-41c3-b4f0-fa13c5797ff1 tempest-BackendsCapabilitiesAdminTestsJSON-911346403 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87009) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 09 09:02:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f152763-92d4-407d-bc10-5d92541832ae tempest-BackendsCapabilitiesAdminTestsJSON-911346403 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87009) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 09 09:02:08 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=26,cinder:UPDATE=32,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:02:09 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=27,cinder:UPDATE=33,cinder:DELETE=4,cinder:INSERT=5 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Flow 'volume_create_manager' (1752466c-9759-46fe-a6d4-ca76a8994aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd1551e-7cb7-48fd-a32d-75440ee6c3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd1551e-7cb7-48fd-a32d-75440ee6c3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2011179136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e5d6e7-48ca-42bb-8258-0447d15c212a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9801cf01d7b24be49979389a55ef9c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:12Z,use_quota=True,user_id='507b1a2eb6d44a459ad3d571a5837e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e90f55f-b723-446e-a24b-9c783dbd05e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e90f55f-b723-446e-a24b-9c783dbd05e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58d520b-39d4-4a85-ac95-a65c680c76c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58d520b-39d4-4a85-ac95-a65c680c76c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31e5d6e7-48ca-42bb-8258-0447d15c212a', 'volume_name': 'volume-31e5d6e7-48ca-42bb-8258-0447d15c212a', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6be43d8-707c-4ad6-90bd-213d7b3c2019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6be43d8-707c-4ad6-90bd-213d7b3c2019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901a828e-acfd-4698-a7ab-05c0dd61e79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:12 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Volume 31e5d6e7-48ca-42bb-8258-0447d15c212a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31e5d6e7-48ca-42bb-8258-0447d15c212a', 'volume_size': 1}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2011179136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e5d6e7-48ca-42bb-8258-0447d15c212a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9801cf01d7b24be49979389a55ef9c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:12Z,use_quota=True,user_id='507b1a2eb6d44a459ad3d571a5837e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Creating volume 31e5d6e7-48ca-42bb-8258-0447d15c212a {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:02:12 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:02:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-31e5d6e7-48ca-42bb-8258-0447d15c212a 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:12 devstack sudo[90125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-31e5d6e7-48ca-42bb-8258-0447d15c212a 1073741824
Jul 09 09:02:12 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:13 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-31e5d6e7-48ca-42bb-8258-0447d15c212a 1073741824" returned: 0 in 1.194s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-31e5d6e7-48ca-42bb-8258-0447d15c212a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:13 devstack sudo[90133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-31e5d6e7-48ca-42bb-8258-0447d15c212a
Jul 09 09:02:13 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:14 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-064dd144-cb44-442f-8acf-bb1104eef772 tempest-GroupsV314Test-1451706501 None] Group tempest-GroupsV314Test-Group-113399983: creating
Jul 09 09:02:14 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-064dd144-cb44-442f-8acf-bb1104eef772 tempest-GroupsV314Test-1451706501 None] Group tempest-GroupsV314Test-Group-113399983: created successfully
Jul 09 09:02:14 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-064dd144-cb44-442f-8acf-bb1104eef772 tempest-GroupsV314Test-1451706501 None] Create group completed successfully.
Jul 09 09:02:14 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-31e5d6e7-48ca-42bb-8258-0447d15c212a" returned: 0 in 0.911s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:14 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:02:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901a828e-acfd-4698-a7ab-05c0dd61e79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e5d6e7-48ca-42bb-8258-0447d15c212a', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ab31db-4235-445e-b2fd-95a581ac4adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:14 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Volume volume-31e5d6e7-48ca-42bb-8258-0447d15c212a (31e5d6e7-48ca-42bb-8258-0447d15c212a): created successfully
Jul 09 09:02:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ab31db-4235-445e-b2fd-95a581ac4adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Flow 'volume_create_manager' (1752466c-9759-46fe-a6d4-ca76a8994aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:14 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e43fffa8-17b1-46de-a945-75142f741d86 tempest-VolumesActionsTest-1833335882 None] Created volume successfully.
Jul 09 09:02:15 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-66ea4bb1-5f44-4d5b-a99c-e3b6e4c2ce5b tempest-VolumesActionsTest-1833335882 None] Acquiring lock "cinder-31e5d6e7-48ca-42bb-8258-0447d15c212a" by "attach_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:15 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-66ea4bb1-5f44-4d5b-a99c-e3b6e4c2ce5b tempest-VolumesActionsTest-1833335882 None] Lock "cinder-31e5d6e7-48ca-42bb-8258-0447d15c212a" acquired by "attach_volume" :: waited 0.034s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:15 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:02:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Flow 'volume_create_manager' (214b9d05-ea91-4d26-a40a-82f5ae38ae5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64a8c9f-6df2-47c9-8c22-e0c5a2d8c1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64a8c9f-6df2-47c9-8c22-e0c5a2d8c1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-891765233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f93fe6f6-0302-45a3-b64c-b9336830a330,host='devstack@QuobyteHD#QuobyteHD',id=acff884a-a947-4c7c-8818-0d058da3201d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6799337d0f464b9eab858fcfc1fdec2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:16Z,use_quota=True,user_id='8c0de9800ba24085a362cd8e2d007c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(709b9b14-b8ea-40fa-a205-1e5fac7a7437),volume_type_id=709b9b14-b8ea-40fa-a205-1e5fac7a7437)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1508daac-a2a2-41a6-8b6d-61c2d5b6fcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1508daac-a2a2-41a6-8b6d-61c2d5b6fcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d51d58-ec61-47e4-a744-f7167e74849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d51d58-ec61-47e4-a744-f7167e74849c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acff884a-a947-4c7c-8818-0d058da3201d', 'volume_name': 'volume-acff884a-a947-4c7c-8818-0d058da3201d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1c6b03-7743-444d-a55e-2aebad2b4ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1c6b03-7743-444d-a55e-2aebad2b4ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512b19f2-316d-4f12-a91b-e2c38f364c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:16 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Volume acff884a-a947-4c7c-8818-0d058da3201d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acff884a-a947-4c7c-8818-0d058da3201d', 'volume_size': 1}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f93fe6f6-0302-45a3-b64c-b9336830a330,created_at=2026-07-09T07:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-891765233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f93fe6f6-0302-45a3-b64c-b9336830a330,host='devstack@QuobyteHD#QuobyteHD',id=acff884a-a947-4c7c-8818-0d058da3201d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6799337d0f464b9eab858fcfc1fdec2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:16Z,use_quota=True,user_id='8c0de9800ba24085a362cd8e2d007c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(709b9b14-b8ea-40fa-a205-1e5fac7a7437),volume_type_id=709b9b14-b8ea-40fa-a205-1e5fac7a7437)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Creating volume acff884a-a947-4c7c-8818-0d058da3201d {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:02:16 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:16 devstack sudo[90149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d 1073741824
Jul 09 09:02:16 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:16 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-66ea4bb1-5f44-4d5b-a99c-e3b6e4c2ce5b tempest-VolumesActionsTest-1833335882 None] Attaching volume 31e5d6e7-48ca-42bb-8258-0447d15c212a to instance ebdc71d5-c36f-4dd8-85e6-2b96223d8941 at mountpoint /dev/vdb on host None.
Jul 09 09:02:16 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-66ea4bb1-5f44-4d5b-a99c-e3b6e4c2ce5b tempest-VolumesActionsTest-1833335882 None] Attach volume completed successfully.
Jul 09 09:02:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-66ea4bb1-5f44-4d5b-a99c-e3b6e4c2ce5b tempest-VolumesActionsTest-1833335882 None] Lock "cinder-31e5d6e7-48ca-42bb-8258-0447d15c212a" released by "attach_volume" :: held 0.378s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:17 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-57e7e6e8-101e-48f3-b225-98d94fd97597 tempest-VolumesActionsTest-1258480349 None] Terminate volume connection completed successfully.
Jul 09 09:02:17 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d 1073741824" returned: 0 in 1.612s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:17 devstack sudo[90172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d
Jul 09 09:02:17 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:17 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-57e7e6e8-101e-48f3-b225-98d94fd97597 tempest-VolumesActionsTest-1258480349 None] Acquiring lock "cinder-31e5d6e7-48ca-42bb-8258-0447d15c212a-detach_volume" by "detach_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:17 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-57e7e6e8-101e-48f3-b225-98d94fd97597 tempest-VolumesActionsTest-1258480349 None] Lock "cinder-31e5d6e7-48ca-42bb-8258-0447d15c212a-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:18 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-57e7e6e8-101e-48f3-b225-98d94fd97597 tempest-VolumesActionsTest-1258480349 None] Detaching volume 31e5d6e7-48ca-42bb-8258-0447d15c212a from instance ebdc71d5-c36f-4dd8-85e6-2b96223d8941.
Jul 09 09:02:18 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-57e7e6e8-101e-48f3-b225-98d94fd97597 tempest-VolumesActionsTest-1258480349 None] Detach volume completed successfully.
Jul 09 09:02:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-57e7e6e8-101e-48f3-b225-98d94fd97597 tempest-VolumesActionsTest-1258480349 None] Lock "cinder-31e5d6e7-48ca-42bb-8258-0447d15c212a-detach_volume" released by "detach_volume" :: held 0.167s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:18 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d" returned: 0 in 0.837s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] <== create_volume: return (2519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:02:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.522s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512b19f2-316d-4f12-a91b-e2c38f364c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acff884a-a947-4c7c-8818-0d058da3201d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7300d57-f875-4343-b96b-3334913bebae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6dc73007-80c9-4bcc-b3b5-35361e8f6d15 tempest-VolumesActionsTest-1833335882 None] Acquiring lock "cinder-31e5d6e7-48ca-42bb-8258-0447d15c212a-detach_volume" by "detach_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:18 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Volume volume-acff884a-a947-4c7c-8818-0d058da3201d (acff884a-a947-4c7c-8818-0d058da3201d): created successfully
Jul 09 09:02:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7300d57-f875-4343-b96b-3334913bebae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Flow 'volume_create_manager' (214b9d05-ea91-4d26-a40a-82f5ae38ae5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:18 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6b7862a7-e907-476e-89bb-54dcb435b242 tempest-GroupsV314Test-1451706501 None] Created volume successfully.
Jul 09 09:02:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6dc73007-80c9-4bcc-b3b5-35361e8f6d15 tempest-VolumesActionsTest-1833335882 None] Lock "cinder-31e5d6e7-48ca-42bb-8258-0447d15c212a-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:18 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6dc73007-80c9-4bcc-b3b5-35361e8f6d15 tempest-VolumesActionsTest-1833335882 None] Volume detach called, but volume not attached.
Jul 09 09:02:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6dc73007-80c9-4bcc-b3b5-35361e8f6d15 tempest-VolumesActionsTest-1833335882 None] Lock "cinder-31e5d6e7-48ca-42bb-8258-0447d15c212a-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Acquiring lock "cinder-31e5d6e7-48ca-42bb-8258-0447d15c212a-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Lock "cinder-31e5d6e7-48ca-42bb-8258-0447d15c212a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Acquiring lock "cinder-quobyte-31e5d6e7-48ca-42bb-8258-0447d15c212a" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Lock "cinder-quobyte-31e5d6e7-48ca-42bb-8258-0447d15c212a" acquired by "delete_volume" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:19 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd19331-8411-4250-b3fa-10a4d2c43d48]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-31e5d6e7-48ca-42bb-8258-0447d15c212a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:19 devstack sudo[90181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-31e5d6e7-48ca-42bb-8258-0447d15c212a
Jul 09 09:02:19 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:20 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-31e5d6e7-48ca-42bb-8258-0447d15c212a" returned: 0 in 0.790s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-31e5d6e7-48ca-42bb-8258-0447d15c212a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:20 devstack sudo[90187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-31e5d6e7-48ca-42bb-8258-0447d15c212a
Jul 09 09:02:20 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:20 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-31e5d6e7-48ca-42bb-8258-0447d15c212a" returned: 0 in 0.694s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:20 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Cloning volume acff884a-a947-4c7c-8818-0d058da3201d to volume 33aa6eb4-53bc-40b1-b03e-0ae469c7dce8
Jul 09 09:02:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Lock "cinder-quobyte-31e5d6e7-48ca-42bb-8258-0447d15c212a" released by "delete_volume" :: held 1.535s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Creating offline snapshot 6351c525-07ce-4f44-9271-5c8ba608baa3 of volume acff884a-a947-4c7c-8818-0d058da3201d {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:02:21 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf737d6-ed65-44fc-918d-1618427be3db]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:21 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Created reservations ['18606698-aa5c-48cb-89ef-0668af327427', 'b96aaba2-e8aa-4341-a48e-bca484f2a0be', 'de1a6db2-e818-45fb-ade6-aa9c691a3f59', '8a400df7-88cf-4d8f-9445-3b0d0e07598f'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:02:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:21 devstack sudo[90190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d
Jul 09 09:02:21 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:21 devstack sudo[90192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:02:21 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:22 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.821s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:22 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:02:22 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Deleted volume successfully.
Jul 09 09:02:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a53d6f2a-087e-46a0-b948-a7ac12c84bd6 tempest-VolumesActionsTest-1833335882 None] Lock "cinder-31e5d6e7-48ca-42bb-8258-0447d15c212a-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:22 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d" returned: 0 in 1.056s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:22 devstack sudo[90199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3 1G
Jul 09 09:02:22 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:23 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3 1G" returned: 0 in 0.898s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acff884a-a947-4c7c-8818-0d058da3201d -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:23 devstack sudo[90212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acff884a-a947-4c7c-8818-0d058da3201d -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3
Jul 09 09:02:23 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Acquiring lock "cinder-0a025178-9ed0-412f-8087-ada32a014271-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Lock "cinder-0a025178-9ed0-412f-8087-ada32a014271-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Acquiring lock "cinder-quobyte-0a025178-9ed0-412f-8087-ada32a014271" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Lock "cinder-quobyte-0a025178-9ed0-412f-8087-ada32a014271" acquired by "delete_volume" :: waited 0.051s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:23 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1e55ab-fa34-411b-8245-827fdb0b1aed]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0a025178-9ed0-412f-8087-ada32a014271 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:23 devstack sudo[90220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0a025178-9ed0-412f-8087-ada32a014271
Jul 09 09:02:23 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:24 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acff884a-a947-4c7c-8818-0d058da3201d -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3" returned: 0 in 1.120s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:24 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3 is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 09:02:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:24 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3
Jul 09 09:02:24 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:24 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0a025178-9ed0-412f-8087-ada32a014271" returned: 0 in 1.265s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0a025178-9ed0-412f-8087-ada32a014271 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:25 devstack sudo[90243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0a025178-9ed0-412f-8087-ada32a014271
Jul 09 09:02:25 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:25 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3" returned: 0 in 0.972s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:25 devstack sudo[90246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.info
Jul 09 09:02:25 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:25 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0a025178-9ed0-412f-8087-ada32a014271" returned: 0 in 0.753s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Lock "cinder-quobyte-0a025178-9ed0-412f-8087-ada32a014271" released by "delete_volume" :: held 2.105s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:25 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Created reservations ['f05a87b9-2938-4144-a890-babea328b731', '70611b6e-8041-439c-b5f1-fdbd5c3e48a7', '42f28058-893a-489a-ad53-2e591290505e', '3c423a17-b3e6-45a2-942c-6e3b7e2b92e6'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:02:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:25 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.info" returned: 0 in 0.722s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:25 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 09:02:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:25 devstack sudo[90255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:02:25 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:25 devstack sudo[90256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.info
Jul 09 09:02:25 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:26 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:26 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.695s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:26 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:02:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.info" returned: 0 in 0.687s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Acquiring lock "cinder-quobyte-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8" by "_copy_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:26 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Deleted volume successfully.
Jul 09 09:02:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Lock "cinder-quobyte-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] snapshot: 6351c525-07ce-4f44-9271-5c8ba608baa3, volume: 33aa6eb4-53bc-40b1-b03e-0ae469c7dce8,  {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 09:02:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd803a18-b812-47b4-a5e4-48b5e8c5f508 tempest-AttachVolumeShelveTestJSON-859210059 None] Lock "cinder-0a025178-9ed0-412f-8087-ada32a014271-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:26 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fdff5d-23f9-46e7-9ac6-22d3b8ec7817]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:26 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3
Jul 09 09:02:26 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:27 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3" returned: 0 in 0.808s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acff884a-a947-4c7c-8818-0d058da3201d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:02:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] will copy from snapshot at /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 09:02:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Creating direct copy from snapshot {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 09:02:27 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cd6bc9-5c44-4c0a-a64c-ff6a51de25b8]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:27 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d
Jul 09 09:02:27 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:28 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d" returned: 0 in 0.914s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:28 devstack cinder-volume[87009]: DEBUG cinder.utils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Path /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8 not found in is_blk_device check {{(pid=87009) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 09:02:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:28 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8
Jul 09 09:02:28 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:31 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:02:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Flow 'volume_create_manager' (68c5669d-d015-43d4-81f4-133b1d0f81c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5e1a59-7c08-4fcd-b495-00f0b962b8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5e1a59-7c08-4fcd-b495-00f0b962b8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-30848864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869bd93f-e13b-48ac-850b-449190a3700b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9801cf01d7b24be49979389a55ef9c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:31Z,use_quota=True,user_id='507b1a2eb6d44a459ad3d571a5837e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcb4e0b-7911-452c-8572-d893318d9c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcb4e0b-7911-452c-8572-d893318d9c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a5b93c-7588-46fc-ac9b-48437cbb84de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a5b93c-7588-46fc-ac9b-48437cbb84de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869bd93f-e13b-48ac-850b-449190a3700b', 'volume_name': 'volume-869bd93f-e13b-48ac-850b-449190a3700b', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8fe658-e67d-4357-92de-cc763c68f07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8fe658-e67d-4357-92de-cc763c68f07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5d91fd-5604-4dec-816b-da56dea6fe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:31 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Volume 869bd93f-e13b-48ac-850b-449190a3700b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869bd93f-e13b-48ac-850b-449190a3700b', 'volume_size': 1}
Jul 09 09:02:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:34 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8" returned: 0 in 6.304s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:34 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[68de11a9-2d8c-4c95-948a-25c9f0daee71]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:34 devstack sudo[90310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d
Jul 09 09:02:34 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:36 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d" returned: 0 in 1.426s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:36 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Image conversion details: src /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8 {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:02:36 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Converted 1024.00 MB image at 162.41 MB/s
Jul 09 09:02:36 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8 is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 09:02:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:36 devstack sudo[90361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8
Jul 09 09:02:36 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:36 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8" returned: 0 in 0.685s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Lock "cinder-quobyte-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8" released by "_copy_volume_from_snapshot" :: held 10.246s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Acquiring lock "cinder-quobyte-6351c525-07ce-4f44-9271-5c8ba608baa3" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Lock "cinder-quobyte-6351c525-07ce-4f44-9271-5c8ba608baa3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Deleting offline snapshot 6351c525-07ce-4f44-9271-5c8ba608baa3 of volume acff884a-a947-4c7c-8818-0d058da3201d {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:02:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] snapshot_file for this snap is: volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:02:36 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b812f6a6-70b6-4745-9ef7-a4e6aa18bf06]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:37 devstack sudo[90367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3
Jul 09 09:02:37 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Flow 'volume_create_manager' (360dceb7-39d2-4fcd-ab22-72b417f192ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73a14fc-4a77-43f6-84b5-4e54ad9f3c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73a14fc-4a77-43f6-84b5-4e54ad9f3c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-260878944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f305818-a469-42da-a1d3-ecc22c73fe15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a454921ce2324a0b951b06043c6b92c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:38Z,use_quota=True,user_id='a2e5cba1f850412da8358affe6b7a1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f094cc2f-4ee1-43df-ad3b-b6c2fc98f2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f094cc2f-4ee1-43df-ad3b-b6c2fc98f2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e491bd66-1a54-4e7e-ac9c-ae090b38a38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e491bd66-1a54-4e7e-ac9c-ae090b38a38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f305818-a469-42da-a1d3-ecc22c73fe15', 'volume_name': 'volume-0f305818-a469-42da-a1d3-ecc22c73fe15', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902810d7-3ea4-4a43-ac68-a02e9804c64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902810d7-3ea4-4a43-ac68-a02e9804c64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e56e6b1-c4f6-49ae-a3d8-6cab52ee5b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:37 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Volume 0f305818-a469-42da-a1d3-ecc22c73fe15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f305818-a469-42da-a1d3-ecc22c73fe15', 'volume_size': 1}
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:37 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3" returned: 0 in 0.793s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acff884a-a947-4c7c-8818-0d058da3201d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[acffb8c7-87c0-4d31-bee8-74e6325ba267]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:37 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d
Jul 09 09:02:37 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:38 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d" returned: 0 in 0.744s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:38 devstack sudo[90379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3
Jul 09 09:02:38 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:39 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3" returned: 0 in 0.709s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:39 devstack sudo[90388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3
Jul 09 09:02:39 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:39 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d.6351c525-07ce-4f44-9271-5c8ba608baa3" returned: 0 in 0.619s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Lock "cinder-quobyte-6351c525-07ce-4f44-9271-5c8ba608baa3" released by "_delete_snapshot" :: held 2.965s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.938s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.413s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-30848864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869bd93f-e13b-48ac-850b-449190a3700b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9801cf01d7b24be49979389a55ef9c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:31Z,use_quota=True,user_id='507b1a2eb6d44a459ad3d571a5837e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Creating volume 869bd93f-e13b-48ac-850b-449190a3700b {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:02:39 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:02:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-869bd93f-e13b-48ac-850b-449190a3700b 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:39 devstack sudo[90391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-869bd93f-e13b-48ac-850b-449190a3700b 1073741824
Jul 09 09:02:39 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:39 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f3c425b6-04d0-40f9-b8e6-93d7ed8b7b6c tempest-GroupsV314Test-1451706501 None] Create group from source-group-f93fe6f6-0302-45a3-b64c-b9336830a330 completed successfully.
Jul 09 09:02:40 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-869bd93f-e13b-48ac-850b-449190a3700b 1073741824" returned: 0 in 0.852s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Acquiring lock "cinder-quobyte-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-869bd93f-e13b-48ac-850b-449190a3700b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Lock "cinder-quobyte-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8" acquired by "delete_volume" :: waited 0.031s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:40 devstack sudo[90397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-869bd93f-e13b-48ac-850b-449190a3700b
Jul 09 09:02:40 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:40 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[54da5579-9222-4682-9918-ab6be033abac]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:40 devstack sudo[90399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8
Jul 09 09:02:40 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:41 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-869bd93f-e13b-48ac-850b-449190a3700b" returned: 0 in 0.682s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.778s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-260878944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f305818-a469-42da-a1d3-ecc22c73fe15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a454921ce2324a0b951b06043c6b92c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:38Z,use_quota=True,user_id='a2e5cba1f850412da8358affe6b7a1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Creating volume 0f305818-a469-42da-a1d3-ecc22c73fe15 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:02:41 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0f305818-a469-42da-a1d3-ecc22c73fe15 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e5d91fd-5604-4dec-816b-da56dea6fe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869bd93f-e13b-48ac-850b-449190a3700b', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:41 devstack sudo[90405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0f305818-a469-42da-a1d3-ecc22c73fe15 1073741824
Jul 09 09:02:41 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca946f8-8bad-4258-b3b4-a42ada0a4506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:41 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Volume volume-869bd93f-e13b-48ac-850b-449190a3700b (869bd93f-e13b-48ac-850b-449190a3700b): created successfully
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca946f8-8bad-4258-b3b4-a42ada0a4506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Flow 'volume_create_manager' (68c5669d-d015-43d4-81f4-133b1d0f81c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:41 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5c908b70-d6bb-4d50-b56c-240f142bd08d tempest-VolumesActionsTest-1833335882 None] Created volume successfully.
Jul 09 09:02:41 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8" returned: 0 in 0.822s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:41 devstack sudo[90408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8
Jul 09 09:02:41 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-229ebc3e-77e9-405c-ab16-8738fb389411 req-97006fec-03ac-4f0e-b0bb-bd62222b948f tempest-TaggedAttachmentsTest-879459073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:42 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Acquiring lock "cinder-869bd93f-e13b-48ac-850b-449190a3700b-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8" returned: 0 in 0.681s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Lock "cinder-quobyte-33aa6eb4-53bc-40b1-b03e-0ae469c7dce8" released by "delete_volume" :: held 1.568s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Lock "cinder-869bd93f-e13b-48ac-850b-449190a3700b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Acquiring lock "cinder-quobyte-869bd93f-e13b-48ac-850b-449190a3700b" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Lock "cinder-quobyte-869bd93f-e13b-48ac-850b-449190a3700b" acquired by "delete_volume" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:42 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0f305818-a469-42da-a1d3-ecc22c73fe15 1073741824" returned: 0 in 0.956s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6996706f-0a82-4606-81d8-45dd7b7173c5]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-869bd93f-e13b-48ac-850b-449190a3700b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Created reservations ['e1517816-a44b-491a-aa23-6e1968bc5a5e'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0f305818-a469-42da-a1d3-ecc22c73fe15 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:42 devstack sudo[90423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0f305818-a469-42da-a1d3-ecc22c73fe15
Jul 09 09:02:42 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:42 devstack cinder-volume[87009]: WARNING cinder.quota [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-800044913 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-800044913, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:02:42 devstack cinder-volume[87009]: WARNING cinder.quota [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-800044913 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-800044913, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Created reservations ['aa213665-d3e3-4e85-a7e7-67a214af5cd5', 'f2896143-27ee-41fa-917d-33e3e6ab4da8', '024104d3-a9ed-49de-a0f3-8a97324b8c7d', 'c5855cac-6518-4e87-a036-c07aa976f391'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:02:42 devstack sudo[90422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-869bd93f-e13b-48ac-850b-449190a3700b
Jul 09 09:02:42 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:42 devstack sudo[90426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:02:42 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:43 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0f305818-a469-42da-a1d3-ecc22c73fe15" returned: 0 in 0.693s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-229ebc3e-77e9-405c-ab16-8738fb389411 req-97006fec-03ac-4f0e-b0bb-bd62222b948f tempest-TaggedAttachmentsTest-879459073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.268s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e56e6b1-c4f6-49ae-a3d8-6cab52ee5b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f305818-a469-42da-a1d3-ecc22c73fe15', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a7f58f-dca5-4f30-9bf0-9d484d774940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ebdcf1-c48d-4cdd-b243-69c694b01e32]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-229ebc3e-77e9-405c-ab16-8738fb389411 req-97006fec-03ac-4f0e-b0bb-bd62222b948f tempest-TaggedAttachmentsTest-879459073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:43 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-869bd93f-e13b-48ac-850b-449190a3700b" returned: 0 in 0.795s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-869bd93f-e13b-48ac-850b-449190a3700b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:43 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Volume volume-0f305818-a469-42da-a1d3-ecc22c73fe15 (0f305818-a469-42da-a1d3-ecc22c73fe15): created successfully
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a7f58f-dca5-4f30-9bf0-9d484d774940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Flow 'volume_create_manager' (360dceb7-39d2-4fcd-ab22-72b417f192ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:43 devstack sudo[90436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-869bd93f-e13b-48ac-850b-449190a3700b
Jul 09 09:02:43 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:43 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-12092652-1e3a-4da7-a85f-4152520d5408 tempest-VolumesTestJSON-1960491062 None] Created volume successfully.
Jul 09 09:02:43 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.682s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:02:43 devstack sudo[90434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81
Jul 09 09:02:43 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:43 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2f42f852-ace0-46d8-90be-b0ca4f9cda14 tempest-GroupsV314Test-1451706501 None] Delete group completed successfully.
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Acquiring lock "cinder-quobyte-acff884a-a947-4c7c-8818-0d058da3201d" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Lock "cinder-quobyte-acff884a-a947-4c7c-8818-0d058da3201d" acquired by "delete_volume" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fae33b9-e567-4efb-b6b1-f9f895e8a56d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:43 devstack sudo[90439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d
Jul 09 09:02:43 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:44 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-869bd93f-e13b-48ac-850b-449190a3700b" returned: 0 in 0.806s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Lock "cinder-quobyte-869bd93f-e13b-48ac-850b-449190a3700b" released by "delete_volume" :: held 1.654s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:44 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-229ebc3e-77e9-405c-ab16-8738fb389411 req-97006fec-03ac-4f0e-b0bb-bd62222b948f tempest-TaggedAttachmentsTest-879459073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81" returned: 0 in 0.897s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-229ebc3e-77e9-405c-ab16-8738fb389411 req-97006fec-03ac-4f0e-b0bb-bd62222b948f tempest-TaggedAttachmentsTest-879459073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.927s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Created reservations ['77abbf55-a3a8-4de1-807e-6937b31b1f50', '812f424d-06ab-482a-b577-b9e74b83114b', '698d244b-a27d-4930-afdf-eaa31153c2c7', 'e3159e55-9058-4728-b469-7ff32d0fd078'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-229ebc3e-77e9-405c-ab16-8738fb389411 req-97006fec-03ac-4f0e-b0bb-bd62222b948f tempest-TaggedAttachmentsTest-879459073 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f987a0b-88f8-48c2-8a3a-2e3e21f3f16e', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:02:44 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-229ebc3e-77e9-405c-ab16-8738fb389411 req-97006fec-03ac-4f0e-b0bb-bd62222b948f tempest-TaggedAttachmentsTest-879459073 None] attachment_update completed successfully.
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:44 devstack sudo[90449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:02:44 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:44 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d" returned: 0 in 0.860s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:44 devstack sudo[90451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d
Jul 09 09:02:44 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Flow 'volume_create_manager' (65d20b7f-2bd0-46dd-9926-a4750d10e6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58476c5-fb29-450c-9198-6215650aab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58476c5-fb29-450c-9198-6215650aab58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1073375889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cbdb29-34f6-416f-bd9c-064a1747d462,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a454921ce2324a0b951b06043c6b92c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:45Z,use_quota=True,user_id='a2e5cba1f850412da8358affe6b7a1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed32db5a-992a-4273-bb60-69001cd3197a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed32db5a-992a-4273-bb60-69001cd3197a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5515ecdc-1ec1-4b1d-aced-fc3361bd40a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5515ecdc-1ec1-4b1d-aced-fc3361bd40a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57cbdb29-34f6-416f-bd9c-064a1747d462', 'volume_name': 'volume-57cbdb29-34f6-416f-bd9c-064a1747d462', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c19ce8b-45f7-4a63-919b-a0694066dde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c19ce8b-45f7-4a63-919b-a0694066dde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1340263b-c308-4ecd-a989-9fdd5fb6434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:44 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Volume 57cbdb29-34f6-416f-bd9c-064a1747d462: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57cbdb29-34f6-416f-bd9c-064a1747d462', 'volume_size': 1}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1073375889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cbdb29-34f6-416f-bd9c-064a1747d462,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a454921ce2324a0b951b06043c6b92c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:45Z,use_quota=True,user_id='a2e5cba1f850412da8358affe6b7a1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Creating volume 57cbdb29-34f6-416f-bd9c-064a1747d462 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:02:44 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:02:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57cbdb29-34f6-416f-bd9c-064a1747d462 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:44 devstack sudo[90520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57cbdb29-34f6-416f-bd9c-064a1747d462 1073741824
Jul 09 09:02:44 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:45 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.832s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:02:45 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Deleted volume successfully.
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-238afaf3-67b8-48a1-b2f8-2b9246f63048 tempest-VolumesActionsTest-1258480349 None] Lock "cinder-869bd93f-e13b-48ac-850b-449190a3700b-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:45 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-acff884a-a947-4c7c-8818-0d058da3201d" returned: 0 in 0.886s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Lock "cinder-quobyte-acff884a-a947-4c7c-8818-0d058da3201d" released by "delete_volume" :: held 1.816s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Flow 'volume_create_manager' (89e70fe1-46ab-4081-8b00-2858fccbf8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3555bb08-b7df-4f71-ad51-9767b6ccf066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3555bb08-b7df-4f71-ad51-9767b6ccf066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-276323196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9e0091-b8cd-45cb-98ec-1a01b677a4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9801cf01d7b24be49979389a55ef9c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:45Z,use_quota=True,user_id='507b1a2eb6d44a459ad3d571a5837e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f25b24-df3b-4a94-8fe6-730dd8e37d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f25b24-df3b-4a94-8fe6-730dd8e37d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e967953-b6f0-4a39-af38-8d2de33b3781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e967953-b6f0-4a39-af38-8d2de33b3781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a9e0091-b8cd-45cb-98ec-1a01b677a4e5', 'volume_name': 'volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af4a1dd-9b64-4bf0-854e-d6d0565d359a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af4a1dd-9b64-4bf0-854e-d6d0565d359a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296cdece-5441-4e82-b3e2-d8bdd88c46c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:45 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Volume 1a9e0091-b8cd-45cb-98ec-1a01b677a4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5', 'volume_size': 1}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Created reservations ['95791d46-14ce-4779-8697-3f070f761b03'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Created reservations ['4916657e-e306-45d5-89f8-87a1464545c0', '9d9b29f5-1703-4415-a6c0-1a0546162f8c', 'e27c35c2-3133-48b8-aceb-cfcbd2c5f458', '7501e8b1-02f8-4edb-8396-9653fd3a7011'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:45 devstack sudo[90844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:02:45 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:45 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57cbdb29-34f6-416f-bd9c-064a1747d462 1073741824" returned: 0 in 0.970s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57cbdb29-34f6-416f-bd9c-064a1747d462 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:45 devstack sudo[90846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57cbdb29-34f6-416f-bd9c-064a1747d462
Jul 09 09:02:45 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:46 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.687s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:02:46 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f9d9337b-9d07-4ef0-8c6f-462ea7ff6aa8 tempest-GroupsV314Test-1451706501 None] Delete group completed successfully.
Jul 09 09:02:46 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57cbdb29-34f6-416f-bd9c-064a1747d462" returned: 0 in 0.693s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.113s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-276323196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9e0091-b8cd-45cb-98ec-1a01b677a4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9801cf01d7b24be49979389a55ef9c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:45Z,use_quota=True,user_id='507b1a2eb6d44a459ad3d571a5837e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Creating volume 1a9e0091-b8cd-45cb-98ec-1a01b677a4e5 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:02:46 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:46 devstack sudo[90851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5 1073741824
Jul 09 09:02:46 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1340263b-c308-4ecd-a989-9fdd5fb6434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57cbdb29-34f6-416f-bd9c-064a1747d462', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102d5ff9-fd75-4d39-b787-76f7e6f32e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:46 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Volume volume-57cbdb29-34f6-416f-bd9c-064a1747d462 (57cbdb29-34f6-416f-bd9c-064a1747d462): created successfully
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (102d5ff9-fd75-4d39-b787-76f7e6f32e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Flow 'volume_create_manager' (65d20b7f-2bd0-46dd-9926-a4750d10e6b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:46 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-cc127bd1-ba7b-4858-a8cb-7fe18ba8def4 tempest-VolumesTestJSON-1960491062 None] Created volume successfully.
Jul 09 09:02:47 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5 1073741824" returned: 0 in 0.913s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:47 devstack sudo[90864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5
Jul 09 09:02:47 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:48 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5" returned: 0 in 0.871s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296cdece-5441-4e82-b3e2-d8bdd88c46c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dde1e72-1b7d-4f40-9516-4bdc82803b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:48 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Volume volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5 (1a9e0091-b8cd-45cb-98ec-1a01b677a4e5): created successfully
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dde1e72-1b7d-4f40-9516-4bdc82803b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Flow 'volume_create_manager' (89e70fe1-46ab-4081-8b00-2858fccbf8c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Flow 'volume_create_manager' (1436a9d3-2878-446d-b3fb-575fbfc73c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1393429-e09e-4c94-943d-39ef5745b466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:48 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a78dbc10-a191-469d-8ef2-63ff07d21c6f tempest-VolumesActionsTest-1833335882 None] Created volume successfully.
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1393429-e09e-4c94-943d-39ef5745b466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1720825075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12aabf9-ca1d-422e-ae0a-56f6de6a36a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a454921ce2324a0b951b06043c6b92c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:48Z,use_quota=True,user_id='a2e5cba1f850412da8358affe6b7a1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4ccbc0-b7ac-40e8-af56-6bda58d87f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4ccbc0-b7ac-40e8-af56-6bda58d87f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4a1755-3aa9-4628-9abe-e11ab9f40913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4a1755-3aa9-4628-9abe-e11ab9f40913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a12aabf9-ca1d-422e-ae0a-56f6de6a36a0', 'volume_name': 'volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a066f596-9a4f-4fc4-9996-c76cf7002370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a066f596-9a4f-4fc4-9996-c76cf7002370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05360e51-a72f-4da9-a4f3-cb997efc4df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:48 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Volume a12aabf9-ca1d-422e-ae0a-56f6de6a36a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0', 'volume_size': 1}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1720825075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12aabf9-ca1d-422e-ae0a-56f6de6a36a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a454921ce2324a0b951b06043c6b92c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:48Z,use_quota=True,user_id='a2e5cba1f850412da8358affe6b7a1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Creating volume a12aabf9-ca1d-422e-ae0a-56f6de6a36a0 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:02:48 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:02:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:48 devstack sudo[90872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0 1073741824
Jul 09 09:02:48 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:49 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Acquiring lock "cinder-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:49 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0 1073741824" returned: 0 in 1.170s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:49 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Lock "cinder-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:49 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Acquiring lock "cinder-quobyte-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:50 devstack sudo[90881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0
Jul 09 09:02:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Lock "cinder-quobyte-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5" acquired by "delete_volume" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:50 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:50 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a9a511-2ace-45ef-a2a9-56dc6fe80b9c]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:50 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5
Jul 09 09:02:50 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:50 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0" returned: 0 in 0.699s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:02:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05360e51-a72f-4da9-a4f3-cb997efc4df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e07922-4a63-4c41-9f91-2c3ecd017e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:50 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Volume volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0 (a12aabf9-ca1d-422e-ae0a-56f6de6a36a0): created successfully
Jul 09 09:02:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e07922-4a63-4c41-9f91-2c3ecd017e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Flow 'volume_create_manager' (1436a9d3-2878-446d-b3fb-575fbfc73c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:50 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2d405856-f133-4926-8224-d705c09c4bc8 tempest-VolumesTestJSON-1960491062 None] Created volume successfully.
Jul 09 09:02:50 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-3d23c9e7-3303-4390-a866-78b02518830e req-5db54e0a-7b86-4044-a6df-1753f9e29da5 tempest-TaggedAttachmentsTest-879459073 None] Terminate volume connection completed successfully.
Jul 09 09:02:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-3d23c9e7-3303-4390-a866-78b02518830e req-5db54e0a-7b86-4044-a6df-1753f9e29da5 tempest-TaggedAttachmentsTest-879459073 None] Deleting attachment 4f987a0b-88f8-48c2-8a3a-2e3e21f3f16e. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:02:50 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5" returned: 0 in 0.934s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:51 devstack sudo[90919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5
Jul 09 09:02:51 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:51 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5" returned: 0 in 0.661s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Lock "cinder-quobyte-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5" released by "delete_volume" :: held 1.647s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:51 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Created reservations ['ad3b799f-83ee-4919-bfb4-bf57fa28a530', '663b8ade-d8f9-429f-a29e-64b672d66edb', '50b34961-eec5-40b9-aaaa-3c3b76206c5c', '0b3480e7-45ab-4776-9b07-90109ac11090'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:02:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:51 devstack sudo[90922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:02:51 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:52 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.987s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:52 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:02:52 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Deleted volume successfully.
Jul 09 09:02:52 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5c192545-8604-4061-b80c-987a47d2297b tempest-VolumesActionsTest-1258480349 None] Lock "cinder-1a9e0091-b8cd-45cb-98ec-1a01b677a4e5-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:52 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:02:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Flow 'volume_create_manager' (2cca6f83-c4a8-4de3-b466-d43a77ddc595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d78bfa-e6f2-4028-a603-44765cff22dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:52 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Acquiring lock "cinder-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d78bfa-e6f2-4028-a603-44765cff22dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1837079326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29aacc06-7cda-4fbd-8901-d67c53a40783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9801cf01d7b24be49979389a55ef9c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:53Z,use_quota=True,user_id='507b1a2eb6d44a459ad3d571a5837e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0683c5b4-f687-4128-86e3-6a7bd57c1ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0683c5b4-f687-4128-86e3-6a7bd57c1ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5aa6d10-f39c-4129-89c5-3ee9332a59ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5aa6d10-f39c-4129-89c5-3ee9332a59ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29aacc06-7cda-4fbd-8901-d67c53a40783', 'volume_name': 'volume-29aacc06-7cda-4fbd-8901-d67c53a40783', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d37e4ad-86d3-4e48-9e9b-5f1fdc52d106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d37e4ad-86d3-4e48-9e9b-5f1fdc52d106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8a6a70-8bb9-4f32-84a9-dab6be19b4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:53 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Volume 29aacc06-7cda-4fbd-8901-d67c53a40783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29aacc06-7cda-4fbd-8901-d67c53a40783', 'volume_size': 1}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1837079326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29aacc06-7cda-4fbd-8901-d67c53a40783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9801cf01d7b24be49979389a55ef9c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:02:53Z,use_quota=True,user_id='507b1a2eb6d44a459ad3d571a5837e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Creating volume 29aacc06-7cda-4fbd-8901-d67c53a40783 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:02:53 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-29aacc06-7cda-4fbd-8901-d67c53a40783 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Lock "cinder-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:53 devstack sudo[90926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-29aacc06-7cda-4fbd-8901-d67c53a40783 1073741824
Jul 09 09:02:53 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Acquiring lock "cinder-quobyte-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Lock "cinder-quobyte-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0" acquired by "delete_volume" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[19374b50-73d0-4e49-9bc7-b46bf63c2dfa]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:53 devstack sudo[90928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0
Jul 09 09:02:53 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:02:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:54 devstack sudo[90953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:02:54 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:54 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0" returned: 0 in 1.152s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:54 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-29aacc06-7cda-4fbd-8901-d67c53a40783 1073741824" returned: 0 in 1.284s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:54 devstack sudo[90957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0
Jul 09 09:02:54 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-29aacc06-7cda-4fbd-8901-d67c53a40783 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:54 devstack sudo[90960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-29aacc06-7cda-4fbd-8901-d67c53a40783
Jul 09 09:02:54 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:55 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.971s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 8 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:02:55 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0" returned: 0 in 1.109s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Lock "cinder-quobyte-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0" released by "delete_volume" :: held 2.309s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:55 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-29aacc06-7cda-4fbd-8901-d67c53a40783" returned: 0 in 1.068s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] <== create_volume: return (2425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.428s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8a6a70-8bb9-4f32-84a9-dab6be19b4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29aacc06-7cda-4fbd-8901-d67c53a40783', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa18d7a8-aff4-4b60-bc21-79edfa1c5b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Created reservations ['b0c7272c-0a9e-45bd-96b9-81380d1c7a91', 'f97962a2-3b02-40b2-ba56-ecd9825af4e4', '0564d00e-ee18-4552-b6f9-366736f19b51', 'edf0f774-558f-426c-89b1-92bdf9de5228'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:02:55 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Volume volume-29aacc06-7cda-4fbd-8901-d67c53a40783 (29aacc06-7cda-4fbd-8901-d67c53a40783): created successfully
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa18d7a8-aff4-4b60-bc21-79edfa1c5b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Flow 'volume_create_manager' (2cca6f83-c4a8-4de3-b466-d43a77ddc595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:55 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-68a6bda7-1e4a-494b-a770-b921665a04c7 tempest-VolumesActionsTest-1833335882 None] Created volume successfully.
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:55 devstack sudo[90968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:02:55 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:56 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.654s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:02:56 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Deleted volume successfully.
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a087215-0974-44fb-aa40-9361fad581db tempest-VolumesTestJSON-1960491062 None] Lock "cinder-a12aabf9-ca1d-422e-ae0a-56f6de6a36a0-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Acquiring lock "cinder-29aacc06-7cda-4fbd-8901-d67c53a40783-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Acquiring lock "cinder-57cbdb29-34f6-416f-bd9c-064a1747d462-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Lock "cinder-57cbdb29-34f6-416f-bd9c-064a1747d462-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Lock "cinder-29aacc06-7cda-4fbd-8901-d67c53a40783-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Acquiring lock "cinder-quobyte-29aacc06-7cda-4fbd-8901-d67c53a40783" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Acquiring lock "cinder-quobyte-57cbdb29-34f6-416f-bd9c-064a1747d462" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Lock "cinder-quobyte-29aacc06-7cda-4fbd-8901-d67c53a40783" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Lock "cinder-quobyte-57cbdb29-34f6-416f-bd9c-064a1747d462" acquired by "delete_volume" :: waited 0.037s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5059b64-0421-4d2f-855e-c2ea3bfcba1a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-29aacc06-7cda-4fbd-8901-d67c53a40783 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e64d05f-6298-4dbd-b54f-337cbf5ee55d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57cbdb29-34f6-416f-bd9c-064a1747d462 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:56 devstack sudo[90972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-29aacc06-7cda-4fbd-8901-d67c53a40783
Jul 09 09:02:56 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:56 devstack sudo[90973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57cbdb29-34f6-416f-bd9c-064a1747d462
Jul 09 09:02:56 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:57 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-29aacc06-7cda-4fbd-8901-d67c53a40783" returned: 0 in 0.811s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-29aacc06-7cda-4fbd-8901-d67c53a40783 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:57 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57cbdb29-34f6-416f-bd9c-064a1747d462" returned: 0 in 0.828s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57cbdb29-34f6-416f-bd9c-064a1747d462 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:57 devstack sudo[90982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-29aacc06-7cda-4fbd-8901-d67c53a40783
Jul 09 09:02:57 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:57 devstack sudo[90984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57cbdb29-34f6-416f-bd9c-064a1747d462
Jul 09 09:02:57 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:58 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-29aacc06-7cda-4fbd-8901-d67c53a40783" returned: 0 in 0.781s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Lock "cinder-quobyte-29aacc06-7cda-4fbd-8901-d67c53a40783" released by "delete_volume" :: held 1.659s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Created reservations ['f2d177a6-e465-4f7c-9c3c-6b27dc091858', '4ee25a18-31cc-4cce-a8a3-5b2013172f7d', '354b540c-7d40-4f1d-8630-d1a6b0b98f20', '2d94e917-ba1b-4c04-bc05-405faa2039bf'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:02:58 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57cbdb29-34f6-416f-bd9c-064a1747d462" returned: 0 in 0.850s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Lock "cinder-quobyte-57cbdb29-34f6-416f-bd9c-064a1747d462" released by "delete_volume" :: held 1.738s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:58 devstack sudo[90988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:02:58 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Created reservations ['b999704c-c0f0-4608-af5f-e1e668adfd02', 'a3870f87-381e-42d6-9a1c-522a6507d5f3', '61db3023-b953-4d40-9278-0cc08d18c3c6', 'ed11c658-5a38-49af-9102-ff3afb8ba34e'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:58 devstack sudo[90991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:02:58 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Acquiring lock "cinder-0f305818-a469-42da-a1d3-ecc22c73fe15-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Lock "cinder-0f305818-a469-42da-a1d3-ecc22c73fe15-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Acquiring lock "cinder-quobyte-0f305818-a469-42da-a1d3-ecc22c73fe15" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Lock "cinder-quobyte-0f305818-a469-42da-a1d3-ecc22c73fe15" acquired by "delete_volume" :: waited 0.029s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caddd7d-449b-4ec7-b314-dcebb065c059]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0f305818-a469-42da-a1d3-ecc22c73fe15 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:59 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.964s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:02:59 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Deleted volume successfully.
Jul 09 09:02:59 devstack sudo[90994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0f305818-a469-42da-a1d3-ecc22c73fe15
Jul 09 09:02:59 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1880032f-8b50-4257-b881-5cbe9127bf45 tempest-VolumesActionsTest-1258480349 None] Lock "cinder-29aacc06-7cda-4fbd-8901-d67c53a40783-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:59 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Flow 'volume_create_manager' (9ed64b76-3fe8-4027-9d47-5d2bb24ab192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972231c1-e510-4cd5-9668-52fc88634896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.202s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:02:59 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Deleted volume successfully.
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972231c1-e510-4cd5-9668-52fc88634896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-291070506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ac7e57-92a0-4011-a746-419adfc7073f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9801cf01d7b24be49979389a55ef9c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:00Z,use_quota=True,user_id='507b1a2eb6d44a459ad3d571a5837e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bd81c1-9b58-4c98-a330-291940286c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bd81c1-9b58-4c98-a330-291940286c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b89207-9d16-45c4-bbe1-719ed8486513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b89207-9d16-45c4-bbe1-719ed8486513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ac7e57-92a0-4011-a746-419adfc7073f', 'volume_name': 'volume-d3ac7e57-92a0-4011-a746-419adfc7073f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2e95c5-69a3-4c0d-a8d4-137f6dfa2e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2e95c5-69a3-4c0d-a8d4-137f6dfa2e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb015d8-fcba-4949-8ffb-f41524d1acc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:02:59 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Volume d3ac7e57-92a0-4011-a746-419adfc7073f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ac7e57-92a0-4011-a746-419adfc7073f', 'volume_size': 1}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-291070506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ac7e57-92a0-4011-a746-419adfc7073f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9801cf01d7b24be49979389a55ef9c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:00Z,use_quota=True,user_id='507b1a2eb6d44a459ad3d571a5837e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Creating volume d3ac7e57-92a0-4011-a746-419adfc7073f {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:02:59 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d3ac7e57-92a0-4011-a746-419adfc7073f 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:02:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-868ed218-5a57-419b-92af-e52b29278fff tempest-VolumesTestJSON-1960491062 None] Lock "cinder-57cbdb29-34f6-416f-bd9c-064a1747d462-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:02:59 devstack sudo[90997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d3ac7e57-92a0-4011-a746-419adfc7073f 1073741824
Jul 09 09:02:59 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:00 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0f305818-a469-42da-a1d3-ecc22c73fe15" returned: 0 in 1.187s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0f305818-a469-42da-a1d3-ecc22c73fe15 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:00 devstack sudo[91003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0f305818-a469-42da-a1d3-ecc22c73fe15
Jul 09 09:03:00 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:00 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d3ac7e57-92a0-4011-a746-419adfc7073f 1073741824" returned: 0 in 1.196s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:00 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d3ac7e57-92a0-4011-a746-419adfc7073f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0f305818-a469-42da-a1d3-ecc22c73fe15" returned: 0 in 0.709s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:00 devstack sudo[91010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d3ac7e57-92a0-4011-a746-419adfc7073f
Jul 09 09:03:00 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Lock "cinder-quobyte-0f305818-a469-42da-a1d3-ecc22c73fe15" released by "delete_volume" :: held 1.960s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:01 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Created reservations ['32407b4e-31d4-44c8-83a4-142dcb483add', '5f8ad6cb-7916-47ad-a739-1d1887901724', '39f4ec0d-325e-471e-8425-775e2a453bb3', '39d97d1b-4a5d-442e-a225-fa10dc8b1f15'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:03:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:01 devstack sudo[91014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:03:01 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:01 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d3ac7e57-92a0-4011-a746-419adfc7073f" returned: 0 in 0.966s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] <== create_volume: return (2212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:03:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:01 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb015d8-fcba-4949-8ffb-f41524d1acc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ac7e57-92a0-4011-a746-419adfc7073f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:01 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef7f6c8-8807-4808-835d-f16a92b16285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:01 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.880s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:02 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:03:02 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Deleted volume successfully.
Jul 09 09:03:02 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Volume volume-d3ac7e57-92a0-4011-a746-419adfc7073f (d3ac7e57-92a0-4011-a746-419adfc7073f): created successfully
Jul 09 09:03:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef7f6c8-8807-4808-835d-f16a92b16285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Flow 'volume_create_manager' (9ed64b76-3fe8-4027-9d47-5d2bb24ab192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:02 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3e77f73b-441e-4668-85d4-fe64b27d947e tempest-VolumesActionsTest-1833335882 None] Created volume successfully.
Jul 09 09:03:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9cc9f92c-60e3-4cb6-8fd4-61e8d2a396d1 tempest-VolumesTestJSON-1960491062 None] Lock "cinder-0f305818-a469-42da-a1d3-ecc22c73fe15-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Acquiring lock "cinder-d3ac7e57-92a0-4011-a746-419adfc7073f-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Lock "cinder-d3ac7e57-92a0-4011-a746-419adfc7073f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Acquiring lock "cinder-quobyte-d3ac7e57-92a0-4011-a746-419adfc7073f" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Lock "cinder-quobyte-d3ac7e57-92a0-4011-a746-419adfc7073f" acquired by "delete_volume" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:03 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8633cf49-12ef-4a7c-b273-4871da84c145]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d3ac7e57-92a0-4011-a746-419adfc7073f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:03 devstack sudo[91042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d3ac7e57-92a0-4011-a746-419adfc7073f
Jul 09 09:03:03 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:04 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d3ac7e57-92a0-4011-a746-419adfc7073f" returned: 0 in 1.091s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d3ac7e57-92a0-4011-a746-419adfc7073f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:04 devstack sudo[91050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d3ac7e57-92a0-4011-a746-419adfc7073f
Jul 09 09:03:04 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:05 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d3ac7e57-92a0-4011-a746-419adfc7073f" returned: 0 in 0.717s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Lock "cinder-quobyte-d3ac7e57-92a0-4011-a746-419adfc7073f" released by "delete_volume" :: held 1.880s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:05 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Created reservations ['53ba3c37-da1b-43e4-91b5-4cee5c691b65', '8efd3a1d-3c13-4658-ac18-c1242ac46cad', '7bfddee3-03c1-4c3d-b276-98b3b094628d', 'b7fff873-ca05-4719-b695-fd52b526b3cc'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:03:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:05 devstack sudo[91053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:03:05 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Flow 'volume_create_manager' (fcf57051-eda3-45d8-837f-3cd097cb6a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6eca01-f4ec-45ae-b1b6-cfb3bffce206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6eca01-f4ec-45ae-b1b6-cfb3bffce206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-489983293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774acc0c-d6b9-4802-b3dc-3e2153711e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9801cf01d7b24be49979389a55ef9c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:06Z,use_quota=True,user_id='507b1a2eb6d44a459ad3d571a5837e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79cab6a0-1430-4d90-8648-fddac520ce75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79cab6a0-1430-4d90-8648-fddac520ce75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42cc2ea7-1c6a-4617-9f25-490a6f8aa69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42cc2ea7-1c6a-4617-9f25-490a6f8aa69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '774acc0c-d6b9-4802-b3dc-3e2153711e11', 'volume_name': 'volume-774acc0c-d6b9-4802-b3dc-3e2153711e11', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf9ebd1-591e-4238-9436-c690ab6ca0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf9ebd1-591e-4238-9436-c690ab6ca0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c5750ee-8bfb-4cca-bde3-b574542e2702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:06 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Volume 774acc0c-d6b9-4802-b3dc-3e2153711e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-774acc0c-d6b9-4802-b3dc-3e2153711e11', 'volume_size': 1}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-489983293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=774acc0c-d6b9-4802-b3dc-3e2153711e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9801cf01d7b24be49979389a55ef9c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:06Z,use_quota=True,user_id='507b1a2eb6d44a459ad3d571a5837e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Creating volume 774acc0c-d6b9-4802-b3dc-3e2153711e11 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:03:06 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-774acc0c-d6b9-4802-b3dc-3e2153711e11 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:06 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:06 devstack sudo[91056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-774acc0c-d6b9-4802-b3dc-3e2153711e11 1073741824
Jul 09 09:03:06 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.942s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:03:06 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Deleted volume successfully.
Jul 09 09:03:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-abc6cc7f-82ff-4127-9397-03e02538a8d5 tempest-VolumesActionsTest-1258480349 None] Lock "cinder-d3ac7e57-92a0-4011-a746-419adfc7073f-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:06 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-bb908c83-77ce-48ea-9c7f-4d0bf52c67dc tempest-GroupSnapshotsTest-1503641295 None] Group tempest-GroupSnapshotsTest-Group-579406245: creating
Jul 09 09:03:06 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-bb908c83-77ce-48ea-9c7f-4d0bf52c67dc tempest-GroupSnapshotsTest-1503641295 None] Group tempest-GroupSnapshotsTest-Group-579406245: created successfully
Jul 09 09:03:06 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-bb908c83-77ce-48ea-9c7f-4d0bf52c67dc tempest-GroupSnapshotsTest-1503641295 None] Create group completed successfully.
Jul 09 09:03:07 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-774acc0c-d6b9-4802-b3dc-3e2153711e11 1073741824" returned: 0 in 0.962s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-774acc0c-d6b9-4802-b3dc-3e2153711e11 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:07 devstack sudo[91062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-774acc0c-d6b9-4802-b3dc-3e2153711e11
Jul 09 09:03:07 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:07 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-774acc0c-d6b9-4802-b3dc-3e2153711e11" returned: 0 in 0.684s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:03:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c5750ee-8bfb-4cca-bde3-b574542e2702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-774acc0c-d6b9-4802-b3dc-3e2153711e11', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a7056a-4917-4f42-a1a8-c0eec0e2b2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:07 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Volume volume-774acc0c-d6b9-4802-b3dc-3e2153711e11 (774acc0c-d6b9-4802-b3dc-3e2153711e11): created successfully
Jul 09 09:03:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a7056a-4917-4f42-a1a8-c0eec0e2b2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Flow 'volume_create_manager' (fcf57051-eda3-45d8-837f-3cd097cb6a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:07 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-1ba35a74-f9ad-44cd-85df-dcf4d7b09a6e tempest-VolumesActionsTest-1833335882 None] Created volume successfully.
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Flow 'volume_create_manager' (c90ef37f-d310-4191-b120-0d08596db7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac36ed53-cb4d-4ba9-b76b-9140da186147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac36ed53-cb4d-4ba9-b76b-9140da186147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-880051226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e70d1a70-b31b-4049-9e0d-da087e5bc046,host='devstack@QuobyteHD#QuobyteHD',id=e9b64be3-8189-48fb-9d3b-f3d99c85345f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89eb931efd4ac3a1afb8c2c12423a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:08Z,use_quota=True,user_id='78dd6c2d399f48368e87d28d72886f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051e45c8-e6f2-475e-a948-dfd18e1bce5f),volume_type_id=051e45c8-e6f2-475e-a948-dfd18e1bce5f)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8988a09e-e150-47fb-ad6c-74f7fde6abea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8988a09e-e150-47fb-ad6c-74f7fde6abea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2c22c2-28d6-4e44-9b87-5644dd53366c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2c22c2-28d6-4e44-9b87-5644dd53366c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b64be3-8189-48fb-9d3b-f3d99c85345f', 'volume_name': 'volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19717333-efd0-41f6-9892-e28f17269ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19717333-efd0-41f6-9892-e28f17269ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82c2f25-b5b9-43f4-a632-bce54c7c70e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:08 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Volume e9b64be3-8189-48fb-9d3b-f3d99c85345f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f', 'volume_size': 1}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e70d1a70-b31b-4049-9e0d-da087e5bc046,created_at=2026-07-09T07:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-880051226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e70d1a70-b31b-4049-9e0d-da087e5bc046,host='devstack@QuobyteHD#QuobyteHD',id=e9b64be3-8189-48fb-9d3b-f3d99c85345f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89eb931efd4ac3a1afb8c2c12423a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:08Z,use_quota=True,user_id='78dd6c2d399f48368e87d28d72886f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(051e45c8-e6f2-475e-a948-dfd18e1bce5f),volume_type_id=051e45c8-e6f2-475e-a948-dfd18e1bce5f)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Creating volume e9b64be3-8189-48fb-9d3b-f3d99c85345f {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:03:08 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:03:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:08 devstack sudo[91067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f 1073741824
Jul 09 09:03:08 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Acquiring lock "cinder-774acc0c-d6b9-4802-b3dc-3e2153711e11-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Lock "cinder-774acc0c-d6b9-4802-b3dc-3e2153711e11-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:09 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=113,cinder:UPDATE=141,cinder:INSERT=32,cinder:DELETE=12 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:03:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Acquiring lock "cinder-quobyte-774acc0c-d6b9-4802-b3dc-3e2153711e11" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Lock "cinder-quobyte-774acc0c-d6b9-4802-b3dc-3e2153711e11" acquired by "delete_volume" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:09 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ad1110-5c24-4ffb-8c6f-92f55c851bff]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-774acc0c-d6b9-4802-b3dc-3e2153711e11 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:09 devstack sudo[91069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-774acc0c-d6b9-4802-b3dc-3e2153711e11
Jul 09 09:03:09 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:09 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f 1073741824" returned: 0 in 1.183s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:09 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=129,cinder:SELECT=103,cinder:INSERT=28,cinder:DELETE=7 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:03:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:09 devstack sudo[91076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f
Jul 09 09:03:09 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Acquiring lock "cinder-4f4469c1-233c-4d3f-ac5f-312ecec1cf81-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Lock "cinder-4f4469c1-233c-4d3f-ac5f-312ecec1cf81-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Acquiring lock "cinder-quobyte-4f4469c1-233c-4d3f-ac5f-312ecec1cf81" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Lock "cinder-quobyte-4f4469c1-233c-4d3f-ac5f-312ecec1cf81" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20989d4-62d3-4226-8bd4-787652728146]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:10 devstack sudo[91078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81
Jul 09 09:03:10 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:10 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-774acc0c-d6b9-4802-b3dc-3e2153711e11" returned: 0 in 1.206s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-774acc0c-d6b9-4802-b3dc-3e2153711e11 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:10 devstack sudo[91084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-774acc0c-d6b9-4802-b3dc-3e2153711e11
Jul 09 09:03:10 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:10 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f" returned: 0 in 0.722s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82c2f25-b5b9-43f4-a632-bce54c7c70e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf69369-18cc-49d3-a48f-c9799ad6a430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:10 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Volume volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f (e9b64be3-8189-48fb-9d3b-f3d99c85345f): created successfully
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf69369-18cc-49d3-a48f-c9799ad6a430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Flow 'volume_create_manager' (c90ef37f-d310-4191-b120-0d08596db7ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-63b96a3e-0b52-45d5-a781-c84c8420cf2a tempest-GroupSnapshotsTest-1503641295 None] Created volume successfully.
Jul 09 09:03:11 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81" returned: 0 in 0.880s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:11 devstack sudo[91092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81
Jul 09 09:03:11 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:11 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-774acc0c-d6b9-4802-b3dc-3e2153711e11" returned: 0 in 0.707s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Lock "cinder-quobyte-774acc0c-d6b9-4802-b3dc-3e2153711e11" released by "delete_volume" :: held 1.982s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Created reservations ['923d9626-e042-488f-b788-597b90f21686', '1160a6c0-02a0-405b-b79d-bed0f5b46948', '5c990c05-0071-4ed8-aee4-7e30b89dcb3b', 'b0777990-04ca-4793-a087-d7add0365907'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:03:11 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] GroupSnapshot 6a993498-0aa2-489b-8893-8badadab6bd3: creating.
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] Group snapshot 6a993498-0aa2-489b-8893-8badadab6bd3: creating. {{(pid=87009) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:11 devstack sudo[91094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:03:11 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] Creating offline snapshot 065d0e32-0932-4ad4-95e1-1694204cd762 of volume e9b64be3-8189-48fb-9d3b-f3d99c85345f {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb18e268-d39b-4e7b-8700-21c9b96a4048]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:11 devstack sudo[91096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f
Jul 09 09:03:11 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:11 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4f4469c1-233c-4d3f-ac5f-312ecec1cf81" returned: 0 in 0.895s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Lock "cinder-quobyte-4f4469c1-233c-4d3f-ac5f-312ecec1cf81" released by "delete_volume" :: held 1.830s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:12 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Created reservations ['ac48a85a-1b14-4180-8da8-96b649dc995b', 'fb758f43-3205-438f-be70-9cf884324c25', '175d447e-a37e-4f7f-807e-08d4d25eeff5', 'bdda17ba-18cc-413d-a7b0-c06c36c0dcf1'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:03:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:12 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.910s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:12 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:03:12 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Deleted volume successfully.
Jul 09 09:03:12 devstack sudo[91137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:03:12 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ca0ca879-6e9a-43d8-b429-72a38a18a19c tempest-VolumesActionsTest-1833335882 None] Lock "cinder-774acc0c-d6b9-4802-b3dc-3e2153711e11-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:12 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f" returned: 0 in 1.040s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:12 devstack sudo[91139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762 1G
Jul 09 09:03:12 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:13 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.878s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:13 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:03:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Deleted volume successfully.
Jul 09 09:03:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1dbda8b-4b4e-4561-b5f7-11c40ab72a08 tempest-TaggedAttachmentsTest-879459073 None] Lock "cinder-4f4469c1-233c-4d3f-ac5f-312ecec1cf81-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:13 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762 1G" returned: 0 in 1.072s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:13 devstack sudo[91148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762
Jul 09 09:03:13 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:14 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762" returned: 0 in 0.786s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:14 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762 is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 09:03:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:14 devstack sudo[91153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762
Jul 09 09:03:14 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:14 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762" returned: 0 in 0.702s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:15 devstack sudo[91157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.info
Jul 09 09:03:15 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:15 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.info" returned: 0 in 0.772s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:15 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 09:03:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:15 devstack sudo[91160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.info
Jul 09 09:03:15 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:16 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.info" returned: 0 in 0.796s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.290s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:16 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-c6ad57b7-06bc-4809-86da-dfce860e5c39 tempest-GroupSnapshotsTest-1503641295 None] group_snapshot 6a993498-0aa2-489b-8893-8badadab6bd3: created successfully
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-065d0e32-0932-4ad4-95e1-1694204cd762-007642f8-5dea-48dc-bea8-89198580999d" by "_create_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-065d0e32-0932-4ad4-95e1-1694204cd762-007642f8-5dea-48dc-bea8-89198580999d" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Creating volume 007642f8-5dea-48dc-bea8-89198580999d from snapshot 065d0e32-0932-4ad4-95e1-1694204cd762 {{(pid=87009) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-007642f8-5dea-48dc-bea8-89198580999d" by "_copy_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-007642f8-5dea-48dc-bea8-89198580999d" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] snapshot: 065d0e32-0932-4ad4-95e1-1694204cd762, volume: 007642f8-5dea-48dc-bea8-89198580999d,  {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdd1c77-8948-44aa-a39e-39690863e346]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:19 devstack sudo[91167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762
Jul 09 09:03:19 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:20 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762" returned: 0 in 0.875s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:03:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] will copy from snapshot at /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 09:03:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Creating direct copy from snapshot {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 09:03:20 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d8bdd2-d26b-4e05-ba85-81c70938c1a0]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:20 devstack sudo[91175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f
Jul 09 09:03:20 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:21 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f" returned: 0 in 0.872s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:21 devstack cinder-volume[87009]: DEBUG cinder.utils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Path /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d not found in is_blk_device check {{(pid=87009) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 09:03:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:21 devstack sudo[91180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d
Jul 09 09:03:21 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:27 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d" returned: 0 in 6.351s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:27 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d51adf1-1716-450d-b1a7-85a741e08209]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:27 devstack sudo[91197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f
Jul 09 09:03:27 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:28 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f" returned: 0 in 1.232s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:28 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Image conversion details: src /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:03:28 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Converted 1024.00 MB image at 161.14 MB/s
Jul 09 09:03:28 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 09:03:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:28 devstack sudo[91204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d
Jul 09 09:03:28 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:29 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=21,cinder:SELECT=18,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:03:29 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=18,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:03:29 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d" returned: 0 in 0.736s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-007642f8-5dea-48dc-bea8-89198580999d" released by "_copy_volume_from_snapshot" :: held 10.231s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-065d0e32-0932-4ad4-95e1-1694204cd762-007642f8-5dea-48dc-bea8-89198580999d" released by "_create_volume_from_snapshot" :: held 10.304s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.330s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:29 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-58ae4819-1400-45ca-ba5f-b7bcc722a7d4 tempest-GroupSnapshotsTest-1503641295 None] Create group from source-snapshot-6a993498-0aa2-489b-8893-8badadab6bd3 completed successfully.
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-007642f8-5dea-48dc-bea8-89198580999d" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-007642f8-5dea-48dc-bea8-89198580999d" acquired by "delete_volume" :: waited 0.040s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[43494f9a-2d1e-4e7e-a9da-52c03da42f61]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Flow 'volume_create_manager' (e34264f9-8e81-4c9a-a4a3-75feaa8dd9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084e830f-b400-4ed5-8985-a68998b548cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084e830f-b400-4ed5-8985-a68998b548cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1653597657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d8a85b-888a-44b0-89a4-37a1230a7650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b100c92d9684ab5b35007473b81d0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:31Z,use_quota=True,user_id='f29d2bf7faec48cca6f236adac8e404b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b468162-54e3-43bf-9b78-ceafc87710b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b468162-54e3-43bf-9b78-ceafc87710b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c15bc2-ee53-4ab5-9103-a5e84aa0810e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c15bc2-ee53-4ab5-9103-a5e84aa0810e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d8a85b-888a-44b0-89a4-37a1230a7650', 'volume_name': 'volume-94d8a85b-888a-44b0-89a4-37a1230a7650', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc51a8a9-839e-411e-bd90-77e99e155e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc51a8a9-839e-411e-bd90-77e99e155e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac00f32c-d6ce-4aa0-af65-6206a0d8f38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:30 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Volume 94d8a85b-888a-44b0-89a4-37a1230a7650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d8a85b-888a-44b0-89a4-37a1230a7650', 'volume_size': 1}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1653597657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d8a85b-888a-44b0-89a4-37a1230a7650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b100c92d9684ab5b35007473b81d0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:31Z,use_quota=True,user_id='f29d2bf7faec48cca6f236adac8e404b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Creating volume 94d8a85b-888a-44b0-89a4-37a1230a7650 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:30 devstack sudo[91207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d
Jul 09 09:03:30 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:03:30 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:03:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-94d8a85b-888a-44b0-89a4-37a1230a7650 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:30 devstack sudo[91209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-94d8a85b-888a-44b0-89a4-37a1230a7650 1073741824
Jul 09 09:03:30 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:31 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d" returned: 0 in 1.132s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:31 devstack sudo[91219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d
Jul 09 09:03:31 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:32 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-94d8a85b-888a-44b0-89a4-37a1230a7650 1073741824" returned: 0 in 1.164s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-94d8a85b-888a-44b0-89a4-37a1230a7650 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:32 devstack sudo[91227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-94d8a85b-888a-44b0-89a4-37a1230a7650
Jul 09 09:03:32 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:32 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-007642f8-5dea-48dc-bea8-89198580999d" returned: 0 in 0.891s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-007642f8-5dea-48dc-bea8-89198580999d" released by "delete_volume" :: held 2.112s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:32 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Created reservations ['f1b5bf76-3300-4d5c-95d7-bc0be49b8422'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:03:32 devstack cinder-volume[87009]: WARNING cinder.quota [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-487573775 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-487573775, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:03:32 devstack cinder-volume[87009]: WARNING cinder.quota [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-487573775 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-487573775, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:03:32 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Created reservations ['00dff4c1-be10-42fd-ba3f-399a6cd055bb', 'd353d393-7dc5-41ab-8c64-09e39b65176d', 'fc9be8e2-2513-4787-be4f-9c8bdc979fc0', '3cdecc11-8027-4596-a7ae-29d33d172488'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:03:32 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-94d8a85b-888a-44b0-89a4-37a1230a7650" returned: 0 in 0.846s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:03:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac00f32c-d6ce-4aa0-af65-6206a0d8f38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d8a85b-888a-44b0-89a4-37a1230a7650', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a576fae6-fcce-4902-9758-f3332776f3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:33 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Volume volume-94d8a85b-888a-44b0-89a4-37a1230a7650 (94d8a85b-888a-44b0-89a4-37a1230a7650): created successfully
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a576fae6-fcce-4902-9758-f3332776f3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Flow 'volume_create_manager' (e34264f9-8e81-4c9a-a4a3-75feaa8dd9af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:33 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-dba4524e-c568-4cbe-b78d-1d342b9f4ca5 tempest-VolumesTransfersV357Test-1875111562 None] Created volume successfully.
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:33 devstack sudo[91231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:03:33 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:33 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] group_snapshot 6a993498-0aa2-489b-8893-8badadab6bd3: deleting
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] group_snapshot 6a993498-0aa2-489b-8893-8badadab6bd3: deleting {{(pid=87009) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-e9b64be3-8189-48fb-9d3b-f3d99c85345f" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-e9b64be3-8189-48fb-9d3b-f3d99c85345f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-065d0e32-0932-4ad4-95e1-1694204cd762" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-065d0e32-0932-4ad4-95e1-1694204cd762" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] Deleting offline snapshot 065d0e32-0932-4ad4-95e1-1694204cd762 of volume e9b64be3-8189-48fb-9d3b-f3d99c85345f {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] snapshot_file for this snap is: volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb42026-a760-4256-95e1-dffc761e51d4]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:33 devstack sudo[91233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762
Jul 09 09:03:33 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:33 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.845s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:33 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:03:33 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-8bb9bac9-adac-49ac-90c7-4c606004e6a2 tempest-GroupSnapshotsTest-1503641295 None] Delete group completed successfully.
Jul 09 09:03:34 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:03:34 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Flow 'volume_create_manager' (d6e6ca48-f29c-4466-9136-9059b6f31e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4ea181-884b-4adc-b858-050ae4e5e173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762" returned: 0 in 1.052s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:34 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:03:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4ea181-884b-4adc-b858-050ae4e5e173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1038313312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce732431-9387-45a1-a21d-388e87de924c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9440fbd2184ab5863586776aca3d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:35Z,use_quota=True,user_id='d397d4e0174f412098a9487790076bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191b4699-34a7-4242-8003-ae4f38a5663a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191b4699-34a7-4242-8003-ae4f38a5663a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83197ac8-fb29-4588-85f8-5c9df81b1472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:34 devstack cinder-volume[87009]: DEBUG cinder.image.glance [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Creating Keystone auth plugin from conf {{(pid=87009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 09:03:34 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb83a8b-bc0b-4da6-9c69-7a22f61c9bfb]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:34 devstack sudo[91239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f
Jul 09 09:03:34 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:35 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a04890be-3076-4791-86f5-37f326c34fd4 tempest-VolumesTransfersV357Test-486333275 None] Transfer volume completed successfully.
Jul 09 09:03:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83197ac8-fb29-4588-85f8-5c9df81b1472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce732431-9387-45a1-a21d-388e87de924c', 'volume_name': 'volume-ce732431-9387-45a1-a21d-388e87de924c', 'volume_size': 1, 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a39f8923563f40339681d0ff8d3f26a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'created_at': datetime.datetime(2026, 7, 9, 6, 52, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 6, 52, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/769ece37-1cae-43d1-b0fa-7053cc01926f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a8e95e0>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4f8890-7dc7-473f-aa1d-662f7bc8e452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4f8890-7dc7-473f-aa1d-662f7bc8e452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c691b727-6bf8-4c03-802b-727fc8bce0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:35 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Volume ce732431-9387-45a1-a21d-388e87de924c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce732431-9387-45a1-a21d-388e87de924c', 'volume_size': 1, 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a39f8923563f40339681d0ff8d3f26a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'created_at': datetime.datetime(2026, 7, 9, 6, 52, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 6, 52, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/769ece37-1cae-43d1-b0fa-7053cc01926f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a8e95e0>}
Jul 09 09:03:35 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Trying to clone ce732431-9387-45a1-a21d-388e87de924c from image 769ece37-1cae-43d1-b0fa-7053cc01926f at location (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]). {{(pid=87009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 09:03:35 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f" returned: 0 in 0.895s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:35 devstack sudo[91264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762
Jul 09 09:03:35 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:35 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_e8yfq2kjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 09:03:35 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Image download 20.69 MB at 20.69 MB/s
Jul 09 09:03:35 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[86550c82-540f-4953-a683-017c909a28e3]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_e8yfq2kjdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:35 devstack sudo[91267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_e8yfq2kjdevstack@QuobyteHD
Jul 09 09:03:35 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Acquiring lock "cinder-94d8a85b-888a-44b0-89a4-37a1230a7650-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Lock "cinder-94d8a85b-888a-44b0-89a4-37a1230a7650-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Acquiring lock "cinder-quobyte-94d8a85b-888a-44b0-89a4-37a1230a7650" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Lock "cinder-quobyte-94d8a85b-888a-44b0-89a4-37a1230a7650" acquired by "delete_volume" :: waited 0.030s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:36 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e9bdca-d7fc-4e61-a58a-56b84c6ba398]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-94d8a85b-888a-44b0-89a4-37a1230a7650 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:36 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_e8yfq2kjdevstack@QuobyteHD" returned: 0 in 0.915s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:36 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Temporary image 769ece37-1cae-43d1-b0fa-7053cc01926f is fetched for user d397d4e0174f412098a9487790076bba. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 09:03:36 devstack sudo[91276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-94d8a85b-888a-44b0-89a4-37a1230a7650
Jul 09 09:03:36 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:36 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[66410bbf-f636-4f87-b9a4-3c4956580e18]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_e8yfq2kjdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:36 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762" returned: 0 in 1.287s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:36 devstack sudo[91278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_e8yfq2kjdevstack@QuobyteHD
Jul 09 09:03:36 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:36 devstack sudo[91280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762
Jul 09 09:03:36 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:37 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-94d8a85b-888a-44b0-89a4-37a1230a7650" returned: 0 in 0.956s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-94d8a85b-888a-44b0-89a4-37a1230a7650 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:37 devstack sudo[91290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-94d8a85b-888a-44b0-89a4-37a1230a7650
Jul 09 09:03:37 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:37 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_e8yfq2kjdevstack@QuobyteHD" returned: 0 in 0.877s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1038313312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce732431-9387-45a1-a21d-388e87de924c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9440fbd2184ab5863586776aca3d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:35Z,use_quota=True,user_id='d397d4e0174f412098a9487790076bba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Creating volume ce732431-9387-45a1-a21d-388e87de924c {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:03:37 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:37 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f.065d0e32-0932-4ad4-95e1-1694204cd762" returned: 0 in 0.805s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:37 devstack sudo[91292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c 1073741824
Jul 09 09:03:37 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-065d0e32-0932-4ad4-95e1-1694204cd762" released by "_delete_snapshot" :: held 4.225s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-e9b64be3-8189-48fb-9d3b-f3d99c85345f" released by "delete_snapshot" :: held 4.266s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:37 devstack cinder-volume[87009]: WARNING cinder.quota [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-487573775 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-487573775, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:03:37 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] Created reservations ['19f2fe83-d031-4cb7-b8fd-4e72ef5c2c95', 'aa4a24d5-8d6b-43e0-83a6-9b28a94b37e1', '4ad5b85c-4038-4cbd-90d5-c8ec43672076', '05b647c1-3214-4fb3-bf39-c54b65160dfe'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:03:37 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-aa00a811-1b63-4611-aa2e-ee2f02cd17f3 tempest-GroupSnapshotsTest-1503641295 None] group_snapshot 6a993498-0aa2-489b-8893-8badadab6bd3: deleted successfully
Jul 09 09:03:38 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-94d8a85b-888a-44b0-89a4-37a1230a7650" returned: 0 in 0.761s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Lock "cinder-quobyte-94d8a85b-888a-44b0-89a4-37a1230a7650" released by "delete_volume" :: held 1.775s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:38 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Created reservations ['73d9f44b-85a9-4559-b5e3-cdbc8328d23c', 'ea7dd9dd-7ba5-4fa1-9f9a-b7484d50f0dc', 'dc29696e-e72d-470e-bd8e-73eb37f05c8f', 'd1e81e43-8d6b-4ef2-81e3-0b3260c8f1b5'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:03:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:38 devstack sudo[91300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:03:38 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:38 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c 1073741824" returned: 0 in 0.966s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:38 devstack sudo[91302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c
Jul 09 09:03:38 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-e9b64be3-8189-48fb-9d3b-f3d99c85345f" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-e9b64be3-8189-48fb-9d3b-f3d99c85345f" acquired by "delete_volume" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Flow 'volume_create_manager' (912e0830-9a29-4dc8-80d5-a35cb81748ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92483bfb-3a25-4728-8b38-2b71823dd8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fbe103-a1cf-40e9-95c3-b9377b0794f7]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92483bfb-3a25-4728-8b38-2b71823dd8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-510419203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bafd209-6285-4471-81c1-706c1c03ff6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b100c92d9684ab5b35007473b81d0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:40Z,use_quota=True,user_id='f29d2bf7faec48cca6f236adac8e404b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad233178-1e19-4c57-9517-7dfd7b7c14b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad233178-1e19-4c57-9517-7dfd7b7c14b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea50b43d-8c49-495b-8c0c-aecfc52e4936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:39 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea50b43d-8c49-495b-8c0c-aecfc52e4936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bafd209-6285-4471-81c1-706c1c03ff6d', 'volume_name': 'volume-1bafd209-6285-4471-81c1-706c1c03ff6d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a41000-d928-4f0f-8924-6c5972841a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a41000-d928-4f0f-8924-6c5972841a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973556f6-4867-436e-914b-e4f4dcccc6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:39 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Volume 1bafd209-6285-4471-81c1-706c1c03ff6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bafd209-6285-4471-81c1-706c1c03ff6d', 'volume_size': 1}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c" returned: 0 in 0.987s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-510419203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bafd209-6285-4471-81c1-706c1c03ff6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b100c92d9684ab5b35007473b81d0f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:40Z,use_quota=True,user_id='f29d2bf7faec48cca6f236adac8e404b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Creating volume 1bafd209-6285-4471-81c1-706c1c03ff6d {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:03:39 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1bafd209-6285-4471-81c1-706c1c03ff6d 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:39 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.309s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:03:39 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Deleted volume successfully.
Jul 09 09:03:39 devstack sudo[91307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1bafd209-6285-4471-81c1-706c1c03ff6d 1073741824
Jul 09 09:03:39 devstack sudo[91306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f
Jul 09 09:03:39 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:39 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5c112c47-47e1-4b68-a474-db9c939718d4 tempest-VolumesTransfersV357Test-1184935243 None] Lock "cinder-94d8a85b-888a-44b0-89a4-37a1230a7650-delete_volume" released by "delete_volume" :: held 3.364s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Attempting download of 769ece37-1cae-43d1-b0fa-7053cc01926f ((None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}])) to volume ce732431-9387-45a1-a21d-388e87de924c. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8c64a1-27fc-4ace-b6d1-6f75d7ff2e62]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_bwnkaw0z {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:40 devstack sudo[91310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_bwnkaw0z
Jul 09 09:03:40 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:40 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f" returned: 0 in 0.980s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:40 devstack sudo[91318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f
Jul 09 09:03:40 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:40 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_bwnkaw0z" returned: 0 in 0.846s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_bwnkaw0z {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:40 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1bafd209-6285-4471-81c1-706c1c03ff6d 1073741824" returned: 0 in 1.093s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1bafd209-6285-4471-81c1-706c1c03ff6d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:40 devstack sudo[91323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_bwnkaw0z
Jul 09 09:03:40 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:40 devstack sudo[91324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1bafd209-6285-4471-81c1-706c1c03ff6d
Jul 09 09:03:40 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:41 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_bwnkaw0z" returned: 1 in 0.835s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_bwnkaw0z' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9563da1f-5a87-4b02-a20e-9f1994bca757]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_e8yfq2kjdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:41 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9b64be3-8189-48fb-9d3b-f3d99c85345f" returned: 0 in 1.032s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-e9b64be3-8189-48fb-9d3b-f3d99c85345f" released by "delete_volume" :: held 2.178s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:41 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1bafd209-6285-4471-81c1-706c1c03ff6d" returned: 0 in 0.883s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Created reservations ['6967154a-ebaa-49e8-9ff3-6629df1153e1'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:03:41 devstack sudo[91331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_e8yfq2kjdevstack@QuobyteHD
Jul 09 09:03:41 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973556f6-4867-436e-914b-e4f4dcccc6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bafd209-6285-4471-81c1-706c1c03ff6d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c24b775-1d13-4a09-a386-8243bc06eb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:41 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Volume volume-1bafd209-6285-4471-81c1-706c1c03ff6d (1bafd209-6285-4471-81c1-706c1c03ff6d): created successfully
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c24b775-1d13-4a09-a386-8243bc06eb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Flow 'volume_create_manager' (912e0830-9a29-4dc8-80d5-a35cb81748ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:41 devstack cinder-volume[87009]: WARNING cinder.db.api [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-487573775']
Jul 09 09:03:41 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Created reservations ['8c346cb5-d997-4fdf-8aa3-c70b5052f0d7', 'bf3ba25c-e79b-4ecd-a3c3-7a4ca5568dee', 'd4f03066-71fc-46ab-8b1d-f5dcecbe24e7', '0da7734e-ae7b-42fe-86f7-7a67a9228ac7'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:03:41 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5821a9ca-8832-44ed-9d26-942becfb64b8 tempest-VolumesTransfersV357Test-1875111562 None] Created volume successfully.
Jul 09 09:03:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:42 devstack sudo[91334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:03:42 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:42 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_e8yfq2kjdevstack@QuobyteHD" returned: 0 in 1.260s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:42 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] 769ece37-1cae-43d1-b0fa-7053cc01926f was qcow2, converting to raw {{(pid=87009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 09:03:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_e8yfq2kjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:42 devstack sudo[91340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_e8yfq2kjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c
Jul 09 09:03:42 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:43 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-18730d7c-6cb6-4f47-ac2e-05ac65e3d3bf tempest-GroupSnapshotsTest-1503641295 None] Group tempest-GroupSnapshotsTest-Group-70687106: creating
Jul 09 09:03:43 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-18730d7c-6cb6-4f47-ac2e-05ac65e3d3bf tempest-GroupSnapshotsTest-1503641295 None] Group tempest-GroupSnapshotsTest-Group-70687106: created successfully
Jul 09 09:03:43 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-18730d7c-6cb6-4f47-ac2e-05ac65e3d3bf tempest-GroupSnapshotsTest-1503641295 None] Create group completed successfully.
Jul 09 09:03:43 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.124s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:43 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:03:43 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6bf6b291-fa5e-47ee-938e-2cf1bac73c67 tempest-GroupSnapshotsTest-1503641295 None] Delete group completed successfully.
Jul 09 09:03:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Acquiring lock "cinder-1bafd209-6285-4471-81c1-706c1c03ff6d-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Lock "cinder-1bafd209-6285-4471-81c1-706c1c03ff6d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Acquiring lock "cinder-quobyte-1bafd209-6285-4471-81c1-706c1c03ff6d" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Lock "cinder-quobyte-1bafd209-6285-4471-81c1-706c1c03ff6d" acquired by "delete_volume" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:43 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c83a865-3313-45e6-b8f9-6f620f2d1be9]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1bafd209-6285-4471-81c1-706c1c03ff6d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:43 devstack sudo[91343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1bafd209-6285-4471-81c1-706c1c03ff6d
Jul 09 09:03:43 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:44 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1bafd209-6285-4471-81c1-706c1c03ff6d" returned: 0 in 0.870s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1bafd209-6285-4471-81c1-706c1c03ff6d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:44 devstack sudo[91355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1bafd209-6285-4471-81c1-706c1c03ff6d
Jul 09 09:03:44 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:44 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:03:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Flow 'volume_create_manager' (d55b83b1-e39d-4223-ad65-d3ed1d1dde4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4019396-edd5-4bc6-ab3e-1617c6979cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4019396-edd5-4bc6-ab3e-1617c6979cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-637697676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7de4e12e-c077-4247-b784-657b67b39429,host='devstack@QuobyteHD#QuobyteHD',id=eba7b0a0-912e-4d16-ab61-b7d112cadff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89eb931efd4ac3a1afb8c2c12423a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:45Z,use_quota=True,user_id='78dd6c2d399f48368e87d28d72886f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c32139b-171b-487c-a28a-b5cda815ef06),volume_type_id=4c32139b-171b-487c-a28a-b5cda815ef06)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27125a5e-2e2f-4d9c-aeb8-741f036ca9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27125a5e-2e2f-4d9c-aeb8-741f036ca9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e4e9b7-380d-4d98-b519-8bc011428101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e4e9b7-380d-4d98-b519-8bc011428101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eba7b0a0-912e-4d16-ab61-b7d112cadff5', 'volume_name': 'volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f328120-a6a4-4d31-a41d-ceaf63921d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f328120-a6a4-4d31-a41d-ceaf63921d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999e3b3a-5176-4a03-aade-dfa44b7ebdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:45 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Volume eba7b0a0-912e-4d16-ab61-b7d112cadff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5', 'volume_size': 1}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7de4e12e-c077-4247-b784-657b67b39429,created_at=2026-07-09T07:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-637697676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7de4e12e-c077-4247-b784-657b67b39429,host='devstack@QuobyteHD#QuobyteHD',id=eba7b0a0-912e-4d16-ab61-b7d112cadff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89eb931efd4ac3a1afb8c2c12423a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:45Z,use_quota=True,user_id='78dd6c2d399f48368e87d28d72886f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c32139b-171b-487c-a28a-b5cda815ef06),volume_type_id=4c32139b-171b-487c-a28a-b5cda815ef06)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Creating volume eba7b0a0-912e-4d16-ab61-b7d112cadff5 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:03:45 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:45 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1bafd209-6285-4471-81c1-706c1c03ff6d" returned: 0 in 0.828s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:45 devstack sudo[91358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5 1073741824
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Lock "cinder-quobyte-1bafd209-6285-4471-81c1-706c1c03ff6d" released by "delete_volume" :: held 1.742s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:45 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Created reservations ['4990bbef-9969-4414-90bf-61eba1d52d17', '92d4e238-126a-49fa-bcdd-6814a8079062', 'fb504e44-9498-4dbc-93af-a0165698d48e', '44dfa7ea-45f4-40fa-ad68-bf5a292871e2'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:45 devstack sudo[91360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:03:45 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:45 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_e8yfq2kjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c" returned: 0 in 2.476s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_e8yfq2kjdevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:03:45 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Converted 112.00 MB image at 45.20 MB/s
Jul 09 09:03:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:45 devstack sudo[91362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c 1G
Jul 09 09:03:45 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:46 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.890s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:46 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:03:46 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Deleted volume successfully.
Jul 09 09:03:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43c3500d-af7f-41a7-b927-069d626a93ac tempest-VolumesTransfersV357Test-1184935243 None] Lock "cinder-1bafd209-6285-4471-81c1-706c1c03ff6d-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:46 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5 1073741824" returned: 0 in 1.212s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:46 devstack sudo[91372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5
Jul 09 09:03:46 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:46 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c 1G" returned: 0 in 1.118s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:46 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bd014a-4127-4d49-84b9-46af23c5c7f2]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:46 devstack sudo[91374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c
Jul 09 09:03:46 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:47 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5" returned: 0 in 0.743s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:03:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999e3b3a-5176-4a03-aade-dfa44b7ebdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1e3c03-5645-4313-b684-7aa9d0e2788f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:47 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Volume volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5 (eba7b0a0-912e-4d16-ab61-b7d112cadff5): created successfully
Jul 09 09:03:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1e3c03-5645-4313-b684-7aa9d0e2788f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Flow 'volume_create_manager' (d55b83b1-e39d-4223-ad65-d3ed1d1dde4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:47 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3f9b467c-25d3-492b-8d76-d26498b95bb3 tempest-GroupSnapshotsTest-1503641295 None] Created volume successfully.
Jul 09 09:03:47 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c" returned: 0 in 0.935s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:47 devstack sudo[91381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c
Jul 09 09:03:47 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Flow 'volume_create_manager' (5103f55c-58a2-4dac-8044-777a3ab1a8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4de12ac-04ec-4d08-88dc-aefe69ca49dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4de12ac-04ec-4d08-88dc-aefe69ca49dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1295860719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7de4e12e-c077-4247-b784-657b67b39429,host='devstack@QuobyteHD#QuobyteHD',id=7166df7a-c1b8-4791-9821-849288f7f900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89eb931efd4ac3a1afb8c2c12423a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:48Z,use_quota=True,user_id='78dd6c2d399f48368e87d28d72886f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c32139b-171b-487c-a28a-b5cda815ef06),volume_type_id=4c32139b-171b-487c-a28a-b5cda815ef06)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21bef1f0-2f86-4da9-af98-7d671ddbc619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21bef1f0-2f86-4da9-af98-7d671ddbc619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a56bb8-5688-4e09-88d4-2560c227eaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a56bb8-5688-4e09-88d4-2560c227eaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7166df7a-c1b8-4791-9821-849288f7f900', 'volume_name': 'volume-7166df7a-c1b8-4791-9821-849288f7f900', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90c8ae9-0cb2-440c-8a81-4d401c8a462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90c8ae9-0cb2-440c-8a81-4d401c8a462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace08d95-e292-4730-9fdb-74373f36284f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:48 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Volume 7166df7a-c1b8-4791-9821-849288f7f900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7166df7a-c1b8-4791-9821-849288f7f900', 'volume_size': 1}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7de4e12e-c077-4247-b784-657b67b39429,created_at=2026-07-09T07:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1295860719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7de4e12e-c077-4247-b784-657b67b39429,host='devstack@QuobyteHD#QuobyteHD',id=7166df7a-c1b8-4791-9821-849288f7f900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89eb931efd4ac3a1afb8c2c12423a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:48Z,use_quota=True,user_id='78dd6c2d399f48368e87d28d72886f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c32139b-171b-487c-a28a-b5cda815ef06),volume_type_id=4c32139b-171b-487c-a28a-b5cda815ef06)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Creating volume 7166df7a-c1b8-4791-9821-849288f7f900 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:03:48 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:48 devstack sudo[91387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900 1073741824
Jul 09 09:03:48 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:48 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c" returned: 1 in 1.401s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Downloaded image 769ece37-1cae-43d1-b0fa-7053cc01926f ((None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}])) to volume ce732431-9387-45a1-a21d-388e87de924c successfully. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Temporary image 769ece37-1cae-43d1-b0fa-7053cc01926f for user d397d4e0174f412098a9487790076bba is deleted. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 09:03:48 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Marking volume ce732431-9387-45a1-a21d-388e87de924c as bootable. {{(pid=87009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 09:03:49 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Copying metadata from image 769ece37-1cae-43d1-b0fa-7053cc01926f to ce732431-9387-45a1-a21d-388e87de924c. {{(pid=87009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 09:03:49 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Creating volume glance metadata for volume ce732431-9387-45a1-a21d-388e87de924c backed by image 769ece37-1cae-43d1-b0fa-7053cc01926f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 09:03:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c691b727-6bf8-4c03-802b-727fc8bce0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce732431-9387-45a1-a21d-388e87de924c', 'volume_size': 1, 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a39f8923563f40339681d0ff8d3f26a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'created_at': datetime.datetime(2026, 7, 9, 6, 52, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 6, 52, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/769ece37-1cae-43d1-b0fa-7053cc01926f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a8e95e0>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed10432-8437-49c1-ade2-d3eac5674633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:49 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Volume volume-ce732431-9387-45a1-a21d-388e87de924c (ce732431-9387-45a1-a21d-388e87de924c): created successfully
Jul 09 09:03:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed10432-8437-49c1-ade2-d3eac5674633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Flow 'volume_create_manager' (d6e6ca48-f29c-4466-9136-9059b6f31e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:49 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-306996ba-a283-4949-b48c-9ba1440c0afe tempest-VolumesImageMetadata-470514877 None] Created volume successfully.
Jul 09 09:03:49 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900 1073741824" returned: 0 in 1.032s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:49 devstack sudo[91398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900
Jul 09 09:03:49 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Acquiring lock "cinder-ce732431-9387-45a1-a21d-388e87de924c-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Lock "cinder-ce732431-9387-45a1-a21d-388e87de924c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Acquiring lock "cinder-quobyte-ce732431-9387-45a1-a21d-388e87de924c" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:03:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Lock "cinder-quobyte-ce732431-9387-45a1-a21d-388e87de924c" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:03:50 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:50 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa16d86-8497-4556-9388-c5ce85ac75fb]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900" returned: 0 in 0.860s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:03:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace08d95-e292-4730-9fdb-74373f36284f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7166df7a-c1b8-4791-9821-849288f7f900', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356b9a97-753e-479c-9da9-cbc63eb3a4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:50 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Volume volume-7166df7a-c1b8-4791-9821-849288f7f900 (7166df7a-c1b8-4791-9821-849288f7f900): created successfully
Jul 09 09:03:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356b9a97-753e-479c-9da9-cbc63eb3a4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Flow 'volume_create_manager' (5103f55c-58a2-4dac-8044-777a3ab1a8d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:50 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-4385b429-8298-4962-ab20-6a5ff3cc6b62 tempest-GroupSnapshotsTest-1503641295 None] Created volume successfully.
Jul 09 09:03:50 devstack sudo[91401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c
Jul 09 09:03:50 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:51 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-aaad81c1-f094-4a57-a5b6-4e55da0ad52a tempest-GroupSnapshotsTest-1503641295 None] Update group completed successfully.
Jul 09 09:03:51 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c" returned: 0 in 0.820s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:51 devstack sudo[91405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c
Jul 09 09:03:51 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:52 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:52 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f3f2041e-695f-4b24-b569-bda893ed1797 tempest-GroupSnapshotsTest-1503641295 None] Update group completed successfully.
Jul 09 09:03:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c" returned: 1 in 0.810s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:03:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:52 devstack sudo[91410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c
Jul 09 09:03:52 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:52 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:03:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Flow 'volume_create_manager' (6519c854-cc66-4add-b6aa-988f851dd487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7469ae21-d564-4aae-bd79-aa6d22190ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7469ae21-d564-4aae-bd79-aa6d22190ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1820168584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d859d1-b430-4c09-b8f9-42cf79e4e95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ec444c2335421abefb4a618e4fc359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:53Z,use_quota=True,user_id='c8347a19c77c4c0687ce5ec7e66aa5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab79ce3d-3a84-4f32-b67f-22a8a1bf81d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab79ce3d-3a84-4f32-b67f-22a8a1bf81d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dfdbaf7-6b85-4027-9ed5-850a4c226d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:52 devstack cinder-volume[87009]: DEBUG cinder.image.glance [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Creating Keystone auth plugin from conf {{(pid=87009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 09:03:52 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ce732431-9387-45a1-a21d-388e87de924c" returned: 0 in 0.678s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:52 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Lock "cinder-quobyte-ce732431-9387-45a1-a21d-388e87de924c" released by "delete_volume" :: held 2.380s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:52 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Created reservations ['7351bcf6-88e3-4e7e-8a3c-0187bf500a44', '74abf6de-d8ef-4253-9ebf-1716d7ff7d5e', 'c29ffd87-99a1-40b6-857d-1e6354e9fa7e', '9ac13d20-3dee-434b-b8dc-f6f9b80192d1'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:53 devstack sudo[91413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:03:53 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dfdbaf7-6b85-4027-9ed5-850a4c226d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65d859d1-b430-4c09-b8f9-42cf79e4e95a', 'volume_name': 'volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a', 'volume_size': 1, 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a39f8923563f40339681d0ff8d3f26a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'created_at': datetime.datetime(2026, 7, 9, 6, 52, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 6, 52, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/769ece37-1cae-43d1-b0fa-7053cc01926f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a92c140>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99c2fb5-a2a0-4f31-b8dc-a75ed433616b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99c2fb5-a2a0-4f31-b8dc-a75ed433616b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07750fce-2df5-4a2d-b4af-0cfcc8de3530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:53 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Volume 65d859d1-b430-4c09-b8f9-42cf79e4e95a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a', 'volume_size': 1, 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a39f8923563f40339681d0ff8d3f26a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'created_at': datetime.datetime(2026, 7, 9, 6, 52, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 6, 52, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/769ece37-1cae-43d1-b0fa-7053cc01926f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a92c140>}
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Trying to clone 65d859d1-b430-4c09-b8f9-42cf79e4e95a from image 769ece37-1cae-43d1-b0fa-7053cc01926f at location (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]). {{(pid=87009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 09:03:53 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f98cbc39-8a35-4fa8-acfb-c9cb6d58f178 tempest-GroupSnapshotsTest-1503641295 None] Update group completed successfully.
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_1yg19373devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 09:03:53 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Image download 20.69 MB at 20.69 MB/s
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[303765c3-f8c8-4a1f-8fb6-440fac0ef5fc]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_1yg19373devstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:53 devstack sudo[91416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_1yg19373devstack@QuobyteHD
Jul 09 09:03:53 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:53 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.859s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:03:53 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Deleted volume successfully.
Jul 09 09:03:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e0cea0e7-6669-4024-930c-991336b0d186 tempest-VolumesImageMetadata-470514877 None] Lock "cinder-ce732431-9387-45a1-a21d-388e87de924c-delete_volume" released by "delete_volume" :: held 3.500s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:03:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:03:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:54 devstack sudo[91419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:03:54 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:54 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_1yg19373devstack@QuobyteHD" returned: 0 in 1.105s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:54 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Temporary image 769ece37-1cae-43d1-b0fa-7053cc01926f is fetched for user c8347a19c77c4c0687ce5ec7e66aa5e0. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 09:03:54 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-93623c56-0b00-4efb-b780-27f2651da59e tempest-GroupSnapshotsTest-1503641295 None] Update group completed successfully.
Jul 09 09:03:54 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4878cd-1933-497d-9e83-75d50e66ae43]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_1yg19373devstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:55 devstack sudo[91425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_1yg19373devstack@QuobyteHD
Jul 09 09:03:55 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:55 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.133s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:03:55 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_1yg19373devstack@QuobyteHD" returned: 0 in 0.967s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1820168584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d859d1-b430-4c09-b8f9-42cf79e4e95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ec444c2335421abefb4a618e4fc359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:53Z,use_quota=True,user_id='c8347a19c77c4c0687ce5ec7e66aa5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:03:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Creating volume 65d859d1-b430-4c09-b8f9-42cf79e4e95a {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:03:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:03:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:03:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:03:55 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:03:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:55 devstack sudo[91446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a 1073741824
Jul 09 09:03:55 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:56 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] GroupSnapshot 89d7ec23-fed3-4422-b232-8dbcc5615ab6: creating.
Jul 09 09:03:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Group snapshot 89d7ec23-fed3-4422-b232-8dbcc5615ab6: creating. {{(pid=87009) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 09 09:03:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:56 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a 1073741824" returned: 0 in 1.039s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:57 devstack sudo[91454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a
Jul 09 09:03:57 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:57 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a" returned: 0 in 0.691s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.110s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Creating offline snapshot 2b26ef06-18bf-4720-bb86-2e8ea8dc33f7 of volume eba7b0a0-912e-4d16-ab61-b7d112cadff5 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Attempting download of 769ece37-1cae-43d1-b0fa-7053cc01926f ((None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}])) to volume 65d859d1-b430-4c09-b8f9-42cf79e4e95a. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfce48e-9d2d-4826-a6da-7dc9acf0f576]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[148bdd6a-fe97-46fe-9d5e-51861fc08aaa]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_6xvparxn {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:57 devstack sudo[91457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5
Jul 09 09:03:57 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Flow 'volume_create_manager' (4a3a0772-b198-4a5d-9bfb-575917bbbdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd29d407-84e3-4172-be83-dd9606a2e6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:57 devstack sudo[91458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_6xvparxn
Jul 09 09:03:57 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd29d407-84e3-4172-be83-dd9606a2e6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-465654493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd7437147fe4fc79840cfb949fbe7d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:58Z,use_quota=True,user_id='fc740534b42e466d84d67d9ea4cc0d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3615b80e-5964-4652-a5e5-683b8827b7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3615b80e-5964-4652-a5e5-683b8827b7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d35019-33b0-4792-820d-0ef7c31363a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d35019-33b0-4792-820d-0ef7c31363a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8', 'volume_name': 'volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6083b693-afb8-406d-879c-dcb83871484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6083b693-afb8-406d-879c-dcb83871484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa38ffa-b649-42e9-8a6f-7117704b6cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:03:57 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Volume 705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8', 'volume_size': 1}
Jul 09 09:03:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:03:58 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5" returned: 0 in 0.811s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:58 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_6xvparxn" returned: 0 in 0.765s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_6xvparxn {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:58 devstack sudo[91467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7 1G
Jul 09 09:03:58 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:58 devstack sudo[91468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_6xvparxn
Jul 09 09:03:58 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:59 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_6xvparxn" returned: 1 in 0.781s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_6xvparxn' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:03:59 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17c869e-c054-4c74-9ee8-080fbf76812f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:03:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_1yg19373devstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:59 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root
Jul 09 09:03:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7 1G" returned: 0 in 0.820s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:03:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:03:59 devstack sudo[91478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7
Jul 09 09:03:59 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:03:59 devstack sudo[91477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_1yg19373devstack@QuobyteHD
Jul 09 09:03:59 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:00 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_1yg19373devstack@QuobyteHD" returned: 0 in 0.851s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:00 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] 769ece37-1cae-43d1-b0fa-7053cc01926f was qcow2, converting to raw {{(pid=87009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 09:04:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_1yg19373devstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:00 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7" returned: 0 in 0.864s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:00 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7 is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 09:04:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:00 devstack sudo[91516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_1yg19373devstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a
Jul 09 09:04:00 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:00 devstack sudo[91517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7
Jul 09 09:04:00 devstack sudo[91517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:01 devstack sudo[91517]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7" returned: 0 in 0.845s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:01 devstack sudo[91548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.info
Jul 09 09:04:01 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:01 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.info" returned: 0 in 0.715s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:01 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 09:04:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:01 devstack sudo[91570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.info
Jul 09 09:04:01 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:02 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_1yg19373devstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a" returned: 0 in 2.096s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:02 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_1yg19373devstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:04:02 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Converted 112.00 MB image at 53.41 MB/s
Jul 09 09:04:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:02 devstack sudo[91572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a 1G
Jul 09 09:04:02 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:02 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.info" returned: 0 in 0.752s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.921s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Creating offline snapshot 2f588eff-33a1-4640-9467-63f459a97955 of volume 7166df7a-c1b8-4791-9821-849288f7f900 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:04:02 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[691a32da-22d4-4e88-844a-b5478d993a91]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:02 devstack sudo[91575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900
Jul 09 09:04:02 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:03 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a 1G" returned: 0 in 0.748s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:03 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[de67c3fb-8de0-4cd1-aa90-8b2e9442e5c1]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:03 devstack sudo[91582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a
Jul 09 09:04:03 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:03 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900" returned: 0 in 0.949s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:03 devstack sudo[91587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955 1G
Jul 09 09:04:03 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:04 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a" returned: 0 in 0.956s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:04 devstack sudo[91591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a
Jul 09 09:04:04 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:04 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955 1G" returned: 0 in 0.915s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7166df7a-c1b8-4791-9821-849288f7f900 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:04 devstack sudo[91597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7166df7a-c1b8-4791-9821-849288f7f900 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955
Jul 09 09:04:04 devstack sudo[91597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:05 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a" returned: 1 in 0.965s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:04:05 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Downloaded image 769ece37-1cae-43d1-b0fa-7053cc01926f ((None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}])) to volume 65d859d1-b430-4c09-b8f9-42cf79e4e95a successfully. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 09:04:05 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Temporary image 769ece37-1cae-43d1-b0fa-7053cc01926f for user c8347a19c77c4c0687ce5ec7e66aa5e0 is deleted. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 09:04:05 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Marking volume 65d859d1-b430-4c09-b8f9-42cf79e4e95a as bootable. {{(pid=87009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 09:04:05 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Copying metadata from image 769ece37-1cae-43d1-b0fa-7053cc01926f to 65d859d1-b430-4c09-b8f9-42cf79e4e95a. {{(pid=87009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 09:04:05 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Creating volume glance metadata for volume 65d859d1-b430-4c09-b8f9-42cf79e4e95a backed by image 769ece37-1cae-43d1-b0fa-7053cc01926f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 09:04:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07750fce-2df5-4a2d-b4af-0cfcc8de3530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a', 'volume_size': 1, 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a39f8923563f40339681d0ff8d3f26a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'created_at': datetime.datetime(2026, 7, 9, 6, 52, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 6, 52, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/769ece37-1cae-43d1-b0fa-7053cc01926f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a92c140>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcccbbb4-945e-4283-980e-405b18402fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:05 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Volume volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a (65d859d1-b430-4c09-b8f9-42cf79e4e95a): created successfully
Jul 09 09:04:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcccbbb4-945e-4283-980e-405b18402fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Flow 'volume_create_manager' (6519c854-cc66-4add-b6aa-988f851dd487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:05 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3603f91c-0633-4da7-8886-643b4c33ad9c tempest-VolumesExtendTest-217996883 None] Created volume successfully.
Jul 09 09:04:05 devstack sudo[91597]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7166df7a-c1b8-4791-9821-849288f7f900 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955" returned: 0 in 0.956s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:05 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955 is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 09:04:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:05 devstack sudo[91606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955
Jul 09 09:04:05 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8b89ec9b-4454-4176-88fa-7784426c4822 tempest-VolumesExtendTest-217996883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:06 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955" returned: 0 in 0.832s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:06 devstack sudo[91611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.info
Jul 09 09:04:06 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:07 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.info" returned: 0 in 0.682s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:07 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 09:04:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:07 devstack sudo[91614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.info
Jul 09 09:04:07 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:07 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.info" returned: 0 in 0.697s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.124s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.765s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-465654493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd7437147fe4fc79840cfb949fbe7d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:03:58Z,use_quota=True,user_id='fc740534b42e466d84d67d9ea4cc0d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:04:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Creating volume 705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:04:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:04:07 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:04:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:07 devstack sudo[91617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8 1073741824
Jul 09 09:04:07 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:07 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-526c6371-d1ba-4a89-bf96-481c30030e6a tempest-GroupSnapshotsTest-1503641295 None] group_snapshot 89d7ec23-fed3-4422-b232-8dbcc5615ab6: created successfully
Jul 09 09:04:08 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] group_snapshot 89d7ec23-fed3-4422-b232-8dbcc5615ab6: deleting
Jul 09 09:04:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] group_snapshot 89d7ec23-fed3-4422-b232-8dbcc5615ab6: deleting {{(pid=87009) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 09 09:04:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-eba7b0a0-912e-4d16-ab61-b7d112cadff5" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-eba7b0a0-912e-4d16-ab61-b7d112cadff5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-2b26ef06-18bf-4720-bb86-2e8ea8dc33f7" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-2b26ef06-18bf-4720-bb86-2e8ea8dc33f7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Deleting offline snapshot 2b26ef06-18bf-4720-bb86-2e8ea8dc33f7 of volume eba7b0a0-912e-4d16-ab61-b7d112cadff5 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:04:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] snapshot_file for this snap is: volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:04:08 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b786a50-3ca4-4705-9934-010cea5bbdd9]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:08 devstack sudo[91623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7
Jul 09 09:04:08 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:08 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8 1073741824" returned: 0 in 0.902s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:08 devstack sudo[91626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8
Jul 09 09:04:08 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:09 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7" returned: 0 in 0.856s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:04:09 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40e4c75-0d87-4c0d-a5e4-45d6d9dd4bf5]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:09 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8" returned: 0 in 0.663s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:04:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8b89ec9b-4454-4176-88fa-7784426c4822 tempest-VolumesExtendTest-217996883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.420s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa38ffa-b649-42e9-8a6f-7117704b6cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4b3042-4bbf-4193-8897-9b42dc24cb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:09 devstack sudo[91632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5
Jul 09 09:04:09 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:09 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[189f46f9-3ce3-4a39-936d-84714b0a4c37]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8b89ec9b-4454-4176-88fa-7784426c4822 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:09 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Volume volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8 (705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8): created successfully
Jul 09 09:04:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4b3042-4bbf-4193-8897-9b42dc24cb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Flow 'volume_create_manager' (4a3a0772-b198-4a5d-9bfb-575917bbbdb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:09 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-024a6c1e-2ac7-468c-b713-826aca038b27 tempest-VolumesMetadataTest-1009220543 None] Created volume successfully.
Jul 09 09:04:09 devstack sudo[91634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a
Jul 09 09:04:09 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:10 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5" returned: 0 in 0.961s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:10 devstack sudo[91641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7
Jul 09 09:04:10 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:10 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8b89ec9b-4454-4176-88fa-7784426c4822 tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a" returned: 0 in 0.986s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8b89ec9b-4454-4176-88fa-7784426c4822 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:10 devstack sudo[91643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a
Jul 09 09:04:10 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Acquiring lock "cinder-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Lock "cinder-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Acquiring lock "cinder-quobyte-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Lock "cinder-quobyte-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8" acquired by "delete_volume" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:10 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c826fc-5d4a-49db-8e89-d206c7952f05]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:10 devstack sudo[91645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8
Jul 09 09:04:10 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:11 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7" returned: 0 in 1.004s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:11 devstack sudo[91652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7
Jul 09 09:04:11 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:11 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8b89ec9b-4454-4176-88fa-7784426c4822 tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a" returned: 1 in 1.012s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8b89ec9b-4454-4176-88fa-7784426c4822 tempest-VolumesExtendTest-217996883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:04:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8b89ec9b-4454-4176-88fa-7784426c4822 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a 2G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8b89ec9b-4454-4176-88fa-7784426c4822 tempest-VolumesExtendTest-217996883 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a 2G" returned: 0 in 0.067s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8b89ec9b-4454-4176-88fa-7784426c4822 tempest-VolumesExtendTest-217996883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.117s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:11 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-8b89ec9b-4454-4176-88fa-7784426c4822 tempest-VolumesExtendTest-217996883 None] Extend volume completed successfully.
Jul 09 09:04:11 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8" returned: 0 in 0.927s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:11 devstack sudo[91663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8
Jul 09 09:04:11 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:11 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5.2b26ef06-18bf-4720-bb86-2e8ea8dc33f7" returned: 0 in 0.736s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-2b26ef06-18bf-4720-bb86-2e8ea8dc33f7" released by "_delete_snapshot" :: held 3.656s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-eba7b0a0-912e-4d16-ab61-b7d112cadff5" released by "delete_snapshot" :: held 3.690s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-7166df7a-c1b8-4791-9821-849288f7f900" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-7166df7a-c1b8-4791-9821-849288f7f900" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-2f588eff-33a1-4640-9467-63f459a97955" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-2f588eff-33a1-4640-9467-63f459a97955" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Deleting offline snapshot 2f588eff-33a1-4640-9467-63f459a97955 of volume 7166df7a-c1b8-4791-9821-849288f7f900 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] snapshot_file for this snap is: volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6454f40-f49a-4abe-92ab-f2e208b4785a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:12 devstack sudo[91666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955
Jul 09 09:04:12 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:12 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8" returned: 0 in 0.689s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Lock "cinder-quobyte-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8" released by "delete_volume" :: held 1.744s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Created reservations ['d02b8f0d-c631-43e9-b280-d0e59ece8693', 'd312367d-1c23-4c0d-8077-343b6945eaa2', '4863c255-a540-493b-9248-7902462365e1', '756d7d59-f6ab-4669-832f-9bcdd65201b1'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:12 devstack sudo[91669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:04:12 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Acquiring lock "cinder-65d859d1-b430-4c09-b8f9-42cf79e4e95a-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Lock "cinder-65d859d1-b430-4c09-b8f9-42cf79e4e95a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Acquiring lock "cinder-quobyte-65d859d1-b430-4c09-b8f9-42cf79e4e95a" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Lock "cinder-quobyte-65d859d1-b430-4c09-b8f9-42cf79e4e95a" acquired by "delete_volume" :: waited 0.044s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f81678e-5099-4181-99be-1bc4189cc006]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:13 devstack sudo[91705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a
Jul 09 09:04:13 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:13 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955" returned: 0 in 1.331s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7166df7a-c1b8-4791-9821-849288f7f900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:04:13 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6fa4de-b031-4656-8d1a-0f349819ba50]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:13 devstack sudo[91712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900
Jul 09 09:04:13 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:13 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.353s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:13 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:04:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Deleted volume successfully.
Jul 09 09:04:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-89288ab9-f9de-4ff2-aa5e-6b955840b2af tempest-VolumesMetadataTest-1009220543 None] Lock "cinder-705b0bd1-aeb1-4b8a-9bda-e4306ca4e3c8-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:14 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a" returned: 0 in 1.249s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:14 devstack sudo[91717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a
Jul 09 09:04:14 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:14 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900" returned: 0 in 1.094s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:14 devstack sudo[91724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955
Jul 09 09:04:14 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:15 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a" returned: 1 in 1.033s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:04:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:15 devstack sudo[91749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a
Jul 09 09:04:15 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:15 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955" returned: 0 in 0.939s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:15 devstack sudo[91754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955
Jul 09 09:04:15 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:15 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-65d859d1-b430-4c09-b8f9-42cf79e4e95a" returned: 0 in 0.801s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:15 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Lock "cinder-quobyte-65d859d1-b430-4c09-b8f9-42cf79e4e95a" released by "delete_volume" :: held 3.195s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Created reservations ['622d750d-6bf0-4c4f-9575-b8b69b7f78cb', '8f04c165-1c22-4c90-9b0e-726624429473', 'd7cb68cc-03fe-4f7c-81b7-08713c435ad0', '85809db5-6c26-46ed-b1e2-081432e2191c'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:16 devstack sudo[91758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:04:16 devstack sudo[91758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:16 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900.2f588eff-33a1-4640-9467-63f459a97955" returned: 0 in 0.694s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-2f588eff-33a1-4640-9467-63f459a97955" released by "_delete_snapshot" :: held 4.181s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-7166df7a-c1b8-4791-9821-849288f7f900" released by "delete_snapshot" :: held 4.207s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:16 devstack cinder-volume[87009]: WARNING cinder.quota [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-451920602 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-451920602, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:04:16 devstack cinder-volume[87009]: WARNING cinder.quota [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-451920602 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-451920602, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Created reservations ['69f6bcb4-6206-47a8-97bb-da2db878f374', 'a0761671-307f-4d4f-a86b-02afe3dafbf1', '1a1d86be-87da-498c-b292-ec05a311e695', '329ec15e-6299-49b0-85b6-ec55823a72c7'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] Created reservations ['27211c9a-9c3b-4122-9f17-9c8770368345', '437656f3-9db8-4ae7-9790-11ecde2e1d68', 'e5d583c9-105d-4be5-baee-a48631b466bc', '19f2fc70-96aa-49da-8535-7138e814a995'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:04:16 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5a7ca444-a64e-43d3-8ae2-d413ab4739b1 tempest-GroupSnapshotsTest-1503641295 None] group_snapshot 89d7ec23-fed3-4422-b232-8dbcc5615ab6: deleted successfully
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Flow 'volume_create_manager' (6f9f75e1-ae52-4d67-9fa6-fb25238bdf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fc657c-b96a-40b3-8695-a76e73c1b96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fc657c-b96a-40b3-8695-a76e73c1b96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1636338175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a094fae4-818d-4d93-b7ff-05d71c8e4d90,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f9769fd147714e148c82ef4515e0816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:17Z,use_quota=True,user_id='507e76fa738d467a93fae7bf8d44845e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a178be-20fd-4a3f-89dd-df5f8b398efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a178be-20fd-4a3f-89dd-df5f8b398efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05dd0737-d5ad-4e9b-aa35-4f5a09cc3f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05dd0737-d5ad-4e9b-aa35-4f5a09cc3f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a094fae4-818d-4d93-b7ff-05d71c8e4d90', 'volume_name': 'volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be00dcff-815f-4b34-b2b1-7de3a4511a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be00dcff-815f-4b34-b2b1-7de3a4511a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:16 devstack sudo[91758]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573b782c-353b-4926-8c77-480bdb3e68cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:16 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Volume a094fae4-818d-4d93-b7ff-05d71c8e4d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90', 'volume_size': 1}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1636338175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a094fae4-818d-4d93-b7ff-05d71c8e4d90,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f9769fd147714e148c82ef4515e0816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:17Z,use_quota=True,user_id='507e76fa738d467a93fae7bf8d44845e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Creating volume a094fae4-818d-4d93-b7ff-05d71c8e4d90 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:04:16 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.686s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:04:16 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Deleted volume successfully.
Jul 09 09:04:16 devstack sudo[91761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90 1073741824
Jul 09 09:04:16 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b18e8e6a-104e-4aa7-a718-8a957c5ff6f4 tempest-VolumesExtendTest-217996883 None] Lock "cinder-65d859d1-b430-4c09-b8f9-42cf79e4e95a-delete_volume" released by "delete_volume" :: held 4.196s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-7166df7a-c1b8-4791-9821-849288f7f900" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-7166df7a-c1b8-4791-9821-849288f7f900" acquired by "delete_volume" :: waited 0.035s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d54b02-1752-4b44-90aa-10f95c7e38be]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Flow 'volume_create_manager' (59dd188d-d621-4561-9140-723398d84583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa41059-7f1b-4147-b84a-e4dcb5ba8e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa41059-7f1b-4147-b84a-e4dcb5ba8e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1802843188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da420222-5c08-40ef-b408-52c1a2689f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ec444c2335421abefb4a618e4fc359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:18Z,use_quota=True,user_id='c8347a19c77c4c0687ce5ec7e66aa5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b79d57-dfac-4750-81ba-f1d2d9177d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b79d57-dfac-4750-81ba-f1d2d9177d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:17 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf50d9d5-1393-4e44-bb12-545408442644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf50d9d5-1393-4e44-bb12-545408442644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da420222-5c08-40ef-b408-52c1a2689f5f', 'volume_name': 'volume-da420222-5c08-40ef-b408-52c1a2689f5f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c590654-2d1f-4e70-8551-c6d500838623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c590654-2d1f-4e70-8551-c6d500838623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf64abe-1f71-4c2f-9712-711412ad69a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:17 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Volume da420222-5c08-40ef-b408-52c1a2689f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da420222-5c08-40ef-b408-52c1a2689f5f', 'volume_size': 1}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90 1073741824" returned: 0 in 1.016s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:17 devstack sudo[91767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900
Jul 09 09:04:17 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:17 devstack sudo[91769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90
Jul 09 09:04:17 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:18 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900" returned: 0 in 0.769s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:18 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90" returned: 0 in 0.630s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:18 devstack sudo[91776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900
Jul 09 09:04:18 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.668s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1802843188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da420222-5c08-40ef-b408-52c1a2689f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ec444c2335421abefb4a618e4fc359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:18Z,use_quota=True,user_id='c8347a19c77c4c0687ce5ec7e66aa5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Creating volume da420222-5c08-40ef-b408-52c1a2689f5f {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:04:18 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573b782c-353b-4926-8c77-480bdb3e68cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:18 devstack sudo[91778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f 1073741824
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd697e4-c286-4f66-88c1-6a34f44df735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:18 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:18 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Volume volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90 (a094fae4-818d-4d93-b7ff-05d71c8e4d90): created successfully
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd697e4-c286-4f66-88c1-6a34f44df735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Flow 'volume_create_manager' (6f9f75e1-ae52-4d67-9fa6-fb25238bdf7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:18 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2c59cba3-d80e-41d9-9de0-059ed8fd8598 tempest-VolumesGetTest-2043637563 None] Created volume successfully.
Jul 09 09:04:19 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7166df7a-c1b8-4791-9821-849288f7f900" returned: 0 in 0.704s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-7166df7a-c1b8-4791-9821-849288f7f900" released by "delete_volume" :: held 1.560s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-eba7b0a0-912e-4d16-ab61-b7d112cadff5" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-eba7b0a0-912e-4d16-ab61-b7d112cadff5" acquired by "delete_volume" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[44523a18-a31a-40a1-be70-287ee7e73558]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:19 devstack sudo[91784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5
Jul 09 09:04:19 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:19 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f 1073741824" returned: 0 in 0.904s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:19 devstack sudo[91786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f
Jul 09 09:04:19 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Flow 'volume_create_manager' (b04cec41-a748-4ce3-ae73-a4b500a79940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0f2ed4-6240-47cf-a81a-772e33ad304f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0f2ed4-6240-47cf-a81a-772e33ad304f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1014447498',display_name='tempest-VolumesGetTest-Volume-111410597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e52563b-234f-4676-bda7-b38f5e92fc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9769fd147714e148c82ef4515e0816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:20Z,use_quota=True,user_id='507e76fa738d467a93fae7bf8d44845e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f659e4-95ae-49dc-913f-b390c8416319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f659e4-95ae-49dc-913f-b390c8416319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58df8be-2365-48d3-b77e-eb1ac0d423e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58df8be-2365-48d3-b77e-eb1ac0d423e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e52563b-234f-4676-bda7-b38f5e92fc02', 'volume_name': 'volume-3e52563b-234f-4676-bda7-b38f5e92fc02', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81afb54b-36f2-4176-a6d3-5c9c05574c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81afb54b-36f2-4176-a6d3-5c9c05574c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c3f80b-670a-4adb-9dee-1685080b5d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:19 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Volume 3e52563b-234f-4676-bda7-b38f5e92fc02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e52563b-234f-4676-bda7-b38f5e92fc02', 'volume_size': 1}
Jul 09 09:04:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:20 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5" returned: 0 in 0.828s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:20 devstack sudo[91793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5
Jul 09 09:04:20 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:20 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f" returned: 0 in 0.702s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1014447498',display_name='tempest-VolumesGetTest-Volume-111410597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e52563b-234f-4676-bda7-b38f5e92fc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9769fd147714e148c82ef4515e0816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:20Z,use_quota=True,user_id='507e76fa738d467a93fae7bf8d44845e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Creating volume 3e52563b-234f-4676-bda7-b38f5e92fc02 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:04:20 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e52563b-234f-4676-bda7-b38f5e92fc02 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:20 devstack sudo[91795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e52563b-234f-4676-bda7-b38f5e92fc02 1073741824
Jul 09 09:04:20 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf64abe-1f71-4c2f-9712-711412ad69a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da420222-5c08-40ef-b408-52c1a2689f5f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7eca8dd-b4ad-4418-a16c-01bf1537f1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:20 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Volume volume-da420222-5c08-40ef-b408-52c1a2689f5f (da420222-5c08-40ef-b408-52c1a2689f5f): created successfully
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7eca8dd-b4ad-4418-a16c-01bf1537f1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Flow 'volume_create_manager' (59dd188d-d621-4561-9140-723398d84583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:20 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-80c5b34c-5f97-4e0d-b154-ec4ebe4fba28 tempest-VolumesExtendTest-217996883 None] Created volume successfully.
Jul 09 09:04:20 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eba7b0a0-912e-4d16-ab61-b7d112cadff5" returned: 0 in 0.637s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-eba7b0a0-912e-4d16-ab61-b7d112cadff5" released by "delete_volume" :: held 1.527s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Created reservations ['96082c1e-95d2-4f02-98c8-6bed0de9b097'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:04:20 devstack cinder-volume[87009]: WARNING cinder.quota [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-451920602 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-451920602, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:04:20 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Created reservations ['a07753f5-be89-4570-8017-6e7370de6b33', '5c79a945-868f-47e5-9915-6872d254d3c3', 'cafb5cf7-729e-43b5-b821-ae867fb269ef', '2b3da732-5ffe-45f7-a02a-f9805d36e5c6'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Created reservations ['03bb9401-0c44-475c-9d74-96c3474e9695', 'ed05ea6d-0727-4c38-8d3c-81697552792c', 'e5e5ff77-0ef4-4734-a3fe-3ec89846c2e2', 'b0266f0d-e4aa-40d6-b3e2-e78724268e17'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:21 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e52563b-234f-4676-bda7-b38f5e92fc02 1073741824" returned: 0 in 0.933s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:21 devstack sudo[91801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:04:21 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e52563b-234f-4676-bda7-b38f5e92fc02 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:21 devstack sudo[91803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e52563b-234f-4676-bda7-b38f5e92fc02
Jul 09 09:04:21 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:21 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-bc83be48-46fa-4bb9-a090-41171cdb854d tempest-GroupSnapshotsTest-1503641295 None] Group tempest-GroupSnapshotsTest-Group-886064650: creating
Jul 09 09:04:21 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-bc83be48-46fa-4bb9-a090-41171cdb854d tempest-GroupSnapshotsTest-1503641295 None] Group tempest-GroupSnapshotsTest-Group-886064650: created successfully
Jul 09 09:04:21 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-bc83be48-46fa-4bb9-a090-41171cdb854d tempest-GroupSnapshotsTest-1503641295 None] Create group completed successfully.
Jul 09 09:04:21 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.733s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:04:21 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-08e58c6f-323d-446b-bb39-f6dbc3500eba tempest-GroupSnapshotsTest-1503641295 None] Delete group completed successfully.
Jul 09 09:04:21 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e52563b-234f-4676-bda7-b38f5e92fc02" returned: 0 in 0.719s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.850s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c3f80b-670a-4adb-9dee-1685080b5d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e52563b-234f-4676-bda7-b38f5e92fc02', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6c04fc-63ad-4323-a3ae-1b1cf557ffdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] Creating offline snapshot 13bb2e01-961d-44ce-9fd4-c295bf31c602 of volume da420222-5c08-40ef-b408-52c1a2689f5f {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4274f9f-02de-4737-8615-992c7f4392d0]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:21 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Volume volume-3e52563b-234f-4676-bda7-b38f5e92fc02 (3e52563b-234f-4676-bda7-b38f5e92fc02): created successfully
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6c04fc-63ad-4323-a3ae-1b1cf557ffdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Flow 'volume_create_manager' (b04cec41-a748-4ce3-ae73-a4b500a79940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:21 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-207d9f6d-9403-4a08-b962-1cb522646f80 tempest-VolumesGetTest-2043637563 None] Created volume successfully.
Jul 09 09:04:22 devstack sudo[91807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f
Jul 09 09:04:22 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:22 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f" returned: 0 in 0.811s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:22 devstack sudo[91814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602 1G
Jul 09 09:04:22 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-3e52563b-234f-4676-bda7-b38f5e92fc02-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Lock "cinder-3e52563b-234f-4676-bda7-b38f5e92fc02-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-quobyte-3e52563b-234f-4676-bda7-b38f5e92fc02" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-3e52563b-234f-4676-bda7-b38f5e92fc02" acquired by "delete_volume" :: waited 0.032s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6e7d23-017e-4d9e-aa59-2680bea43228]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e52563b-234f-4676-bda7-b38f5e92fc02 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:23 devstack sudo[91816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e52563b-234f-4676-bda7-b38f5e92fc02
Jul 09 09:04:23 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Flow 'volume_create_manager' (a76d9ad1-f8fd-4ef9-bcfa-fe1e0803d27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc532b78-4dd8-43d4-83b2-2fb473241fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc532b78-4dd8-43d4-83b2-2fb473241fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1934996294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e8ab37d4-ae5b-4964-8161-869389f8ff47,host='devstack@QuobyteHD#QuobyteHD',id=361e6c1a-956e-4297-a3c7-b15091e2a791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89eb931efd4ac3a1afb8c2c12423a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:23Z,use_quota=True,user_id='78dd6c2d399f48368e87d28d72886f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5724fae5-2e54-40bb-a20f-cd09256ce68d),volume_type_id=5724fae5-2e54-40bb-a20f-cd09256ce68d)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ca2b30-fb65-4cf9-a1ac-b7a9031ade3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ca2b30-fb65-4cf9-a1ac-b7a9031ade3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20ff8fd-a1d3-4015-bda6-679ad18bba3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20ff8fd-a1d3-4015-bda6-679ad18bba3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361e6c1a-956e-4297-a3c7-b15091e2a791', 'volume_name': 'volume-361e6c1a-956e-4297-a3c7-b15091e2a791', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f89e209-ab90-4710-b355-143acfccd53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f89e209-ab90-4710-b355-143acfccd53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81be141-649c-4741-ad0e-2ba558601289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:23 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Volume 361e6c1a-956e-4297-a3c7-b15091e2a791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361e6c1a-956e-4297-a3c7-b15091e2a791', 'volume_size': 1}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:23 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602 1G" returned: 0 in 1.057s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da420222-5c08-40ef-b408-52c1a2689f5f -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:23 devstack sudo[91822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da420222-5c08-40ef-b408-52c1a2689f5f -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602
Jul 09 09:04:23 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:24 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e52563b-234f-4676-bda7-b38f5e92fc02" returned: 0 in 0.927s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e52563b-234f-4676-bda7-b38f5e92fc02 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:24 devstack sudo[91827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e52563b-234f-4676-bda7-b38f5e92fc02
Jul 09 09:04:24 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:24 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da420222-5c08-40ef-b408-52c1a2689f5f -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602" returned: 0 in 0.728s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:24 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602 is being set with open permissions: ugo+rw
Jul 09 09:04:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:24 devstack sudo[91832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602
Jul 09 09:04:24 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:24 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e52563b-234f-4676-bda7-b38f5e92fc02" returned: 0 in 0.692s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:24 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-3e52563b-234f-4676-bda7-b38f5e92fc02" released by "delete_volume" :: held 1.701s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:24 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Created reservations ['bbdd7770-2341-470a-bf63-5df56a730daa', '56676ce4-aeee-47f2-9b92-a31526dfdc8c', 'f82c6273-b8de-4fb0-871a-8bf456f68ea1', '464aa459-e169-4def-a37d-81146f14e482'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:04:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:24 devstack sudo[91835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:04:24 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:25 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602" returned: 0 in 0.690s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:25 devstack sudo[91838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.info
Jul 09 09:04:25 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-a094fae4-818d-4d93-b7ff-05d71c8e4d90-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Lock "cinder-a094fae4-818d-4d93-b7ff-05d71c8e4d90-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-quobyte-a094fae4-818d-4d93-b7ff-05d71c8e4d90" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-a094fae4-818d-4d93-b7ff-05d71c8e4d90" acquired by "delete_volume" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:25 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf364d9-9b19-4224-b83e-0b27d79fa2ac]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:25 devstack sudo[91840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90
Jul 09 09:04:25 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:25 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.678s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:25 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:04:25 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Deleted volume successfully.
Jul 09 09:04:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e3b310d0-41a1-4608-8825-0ee0e6f2111f tempest-VolumesGetTest-2043637563 None] Lock "cinder-3e52563b-234f-4676-bda7-b38f5e92fc02-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:25 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.info" returned: 0 in 0.710s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:25 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.info is being set with open permissions: ugo+rw
Jul 09 09:04:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:26 devstack sudo[91844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.info
Jul 09 09:04:26 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:26 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90" returned: 0 in 0.874s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:26 devstack sudo[91851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90
Jul 09 09:04:26 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:26 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.info" returned: 0 in 0.704s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.821s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.068s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e8ab37d4-ae5b-4964-8161-869389f8ff47,created_at=2026-07-09T07:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1934996294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e8ab37d4-ae5b-4964-8161-869389f8ff47,host='devstack@QuobyteHD#QuobyteHD',id=361e6c1a-956e-4297-a3c7-b15091e2a791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd89eb931efd4ac3a1afb8c2c12423a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:23Z,use_quota=True,user_id='78dd6c2d399f48368e87d28d72886f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5724fae5-2e54-40bb-a20f-cd09256ce68d),volume_type_id=5724fae5-2e54-40bb-a20f-cd09256ce68d)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:04:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Creating volume 361e6c1a-956e-4297-a3c7-b15091e2a791 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:04:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:04:26 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:04:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:26 devstack sudo[91854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791 1073741824
Jul 09 09:04:26 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:26 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-1bc9b1d1-46f1-4bc1-8e39-c8371d79fd03 tempest-VolumesExtendTest-217996883 None] Create snapshot completed successfully
Jul 09 09:04:27 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a094fae4-818d-4d93-b7ff-05d71c8e4d90" returned: 0 in 0.682s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-a094fae4-818d-4d93-b7ff-05d71c8e4d90" released by "delete_volume" :: held 1.632s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Flow 'volume_create_manager' (d7741fb8-becb-44aa-bd10-894728d65de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c48be2d-dd3f-445b-9ee8-83649d996f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c48be2d-dd3f-445b-9ee8-83649d996f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-441121288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f32aa2b4ff2440f198f54c8f06e85637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:27Z,use_quota=True,user_id='40b9a8d1574a4d0f981001e270c9da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b432a80f-d426-49cf-bf9c-967a75c5738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b432a80f-d426-49cf-bf9c-967a75c5738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bffa4f4-5bab-4d91-838a-4ab108aa5ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bffa4f4-5bab-4d91-838a-4ab108aa5ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb', 'volume_name': 'volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d43f85-2eac-4e5d-b44a-b2dbe52d3020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d43f85-2eac-4e5d-b44a-b2dbe52d3020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6d6e63-412d-4c71-a64e-82e7fa486e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:27 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Volume f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb', 'volume_size': 1}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Created reservations ['03a3d236-c445-452a-80c1-7220d2cd5cf4', '72f47eee-6bcf-440d-a52c-8be78e59e069', '50d1af82-2f7b-47d9-9571-0df37aeb4d54', '7e83568e-a5dc-4828-9a21-e9e7b90b2b3b'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:27 devstack sudo[91859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:04:27 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e0788333-a211-4a94-926f-6b6cf67b694d tempest-VolumesExtendTest-217996883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:27 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791 1073741824" returned: 0 in 1.094s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:27 devstack sudo[91863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791
Jul 09 09:04:27 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:28 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Flow 'volume_create_manager' (dc4d072d-24ff-46c4-aa83-da69dfcafbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287689ec-af16-4de2-b5ca-7bf29020aedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.976s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287689ec-af16-4de2-b5ca-7bf29020aedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1349415670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ef4156-52d8-4fa5-b23e-327529a6d1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9769fd147714e148c82ef4515e0816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:28Z,use_quota=True,user_id='507e76fa738d467a93fae7bf8d44845e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8f94cc-1c3e-41f6-a426-a90e32a60b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8f94cc-1c3e-41f6-a426-a90e32a60b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8077f2eb-5ec5-4faf-af78-cfc8788d2ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8077f2eb-5ec5-4faf-af78-cfc8788d2ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ef4156-52d8-4fa5-b23e-327529a6d1ae', 'volume_name': 'volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c0989d-44b6-4d9c-82fa-567b2ed547d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c0989d-44b6-4d9c-82fa-567b2ed547d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46c8f92-155b-44b1-97a0-78b74e697f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:28 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Volume 21ef4156-52d8-4fa5-b23e-327529a6d1ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae', 'volume_size': 1}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:28 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Deleted volume successfully.
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1112f232-3139-426a-b501-6f8d559e9642 tempest-VolumesGetTest-2043637563 None] Lock "cinder-a094fae4-818d-4d93-b7ff-05d71c8e4d90-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:28 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791" returned: 0 in 0.730s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.388s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-441121288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f32aa2b4ff2440f198f54c8f06e85637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:27Z,use_quota=True,user_id='40b9a8d1574a4d0f981001e270c9da21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Creating volume f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:04:28 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:28 devstack sudo[91868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb 1073741824
Jul 09 09:04:28 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81be141-649c-4741-ad0e-2ba558601289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361e6c1a-956e-4297-a3c7-b15091e2a791', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f07c72c-f4f3-4c66-a109-9f821430d730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:28 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Volume volume-361e6c1a-956e-4297-a3c7-b15091e2a791 (361e6c1a-956e-4297-a3c7-b15091e2a791): created successfully
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f07c72c-f4f3-4c66-a109-9f821430d730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Flow 'volume_create_manager' (a76d9ad1-f8fd-4ef9-bcfa-fe1e0803d27c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:28 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d5c44f41-035e-4f8b-bbda-76304e27c0a6 tempest-GroupSnapshotsTest-1503641295 None] Created volume successfully.
Jul 09 09:04:29 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb 1073741824" returned: 0 in 0.864s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:29 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=170,cinder:SELECT=143,cinder:INSERT=50,cinder:DELETE=6 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:04:29 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=164,cinder:SELECT=157,cinder:INSERT=49,cinder:DELETE=13 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:04:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:29 devstack sudo[91874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb
Jul 09 09:04:29 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:29 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] GroupSnapshot ba60230e-03e0-4747-b8b0-d78da9f6a7f2: creating.
Jul 09 09:04:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] Group snapshot ba60230e-03e0-4747-b8b0-d78da9f6a7f2: creating. {{(pid=87009) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 09 09:04:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:30 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb" returned: 0 in 0.713s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:04:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e0788333-a211-4a94-926f-6b6cf67b694d tempest-VolumesExtendTest-217996883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.711s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6d6e63-412d-4c71-a64e-82e7fa486e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e35f3e2-85ef-4d4b-9f57-6bd7ce6137cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:30 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea9ff4c-1a60-406d-9a39-7e9197d3dbef]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0788333-a211-4a94-926f-6b6cf67b694d tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:30 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Volume volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb (f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb): created successfully
Jul 09 09:04:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e35f3e2-85ef-4d4b-9f57-6bd7ce6137cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Flow 'volume_create_manager' (d7741fb8-becb-44aa-bd10-894728d65de9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:30 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-9d22dbe3-934f-4c4c-ba36-476dba1aa5c6 tempest-ServerActionsTestOtherA-1511266625 None] Created volume successfully.
Jul 09 09:04:30 devstack sudo[91880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f
Jul 09 09:04:30 devstack sudo[91880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:31 devstack sudo[91880]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0788333-a211-4a94-926f-6b6cf67b694d tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f" returned: 0 in 0.783s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0788333-a211-4a94-926f-6b6cf67b694d tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602 2G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0788333-a211-4a94-926f-6b6cf67b694d tempest-VolumesExtendTest-217996883 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602 2G" returned: 0 in 0.112s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e0788333-a211-4a94-926f-6b6cf67b694d tempest-VolumesExtendTest-217996883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.936s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.784s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1349415670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ef4156-52d8-4fa5-b23e-327529a6d1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9769fd147714e148c82ef4515e0816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:28Z,use_quota=True,user_id='507e76fa738d467a93fae7bf8d44845e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Creating volume 21ef4156-52d8-4fa5-b23e-327529a6d1ae {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:04:31 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:31 devstack sudo[91889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae 1073741824
Jul 09 09:04:31 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:31 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e0788333-a211-4a94-926f-6b6cf67b694d tempest-VolumesExtendTest-217996883 None] Extend volume completed successfully.
Jul 09 09:04:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Acquiring lock "cinder-13bb2e01-961d-44ce-9fd4-c295bf31c602-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:32 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Lock "cinder-13bb2e01-961d-44ce-9fd4-c295bf31c602-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Acquiring lock "cinder-quobyte-da420222-5c08-40ef-b408-52c1a2689f5f" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae 1073741824" returned: 0 in 0.830s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Lock "cinder-quobyte-da420222-5c08-40ef-b408-52c1a2689f5f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Acquiring lock "cinder-quobyte-13bb2e01-961d-44ce-9fd4-c295bf31c602" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Lock "cinder-quobyte-13bb2e01-961d-44ce-9fd4-c295bf31c602" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Deleting offline snapshot 13bb2e01-961d-44ce-9fd4-c295bf31c602 of volume da420222-5c08-40ef-b408-52c1a2689f5f {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] snapshot_file for this snap is: volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dcf407-a940-4703-9d4c-2818b532fcde]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:32 devstack sudo[91900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae
Jul 09 09:04:32 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:32 devstack sudo[91901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602
Jul 09 09:04:32 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:32 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae" returned: 0 in 0.653s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.855s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46c8f92-155b-44b1-97a0-78b74e697f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f35e10-e6cb-4304-8ad8-5b5eba69f8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] Creating offline snapshot 5037578b-9dd7-4050-aac6-3fe43c2702b7 of volume 361e6c1a-956e-4297-a3c7-b15091e2a791 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:04:32 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Volume volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae (21ef4156-52d8-4fa5-b23e-327529a6d1ae): created successfully
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f35e10-e6cb-4304-8ad8-5b5eba69f8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Flow 'volume_create_manager' (dc4d072d-24ff-46c4-aa83-da69dfcafbe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9874c30-f9d1-4858-a45a-b8ac96705f0f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:32 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e7d2db0a-5c15-4067-87ee-273e0de2f666 tempest-VolumesGetTest-2043637563 None] Created volume successfully.
Jul 09 09:04:32 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602" returned: 0 in 0.784s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da420222-5c08-40ef-b408-52c1a2689f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f9281b-3c6a-4c3d-9d01-d6d086fcc842]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:32 devstack sudo[91908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791
Jul 09 09:04:32 devstack sudo[91908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:33 devstack sudo[91909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f
Jul 09 09:04:33 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:33 devstack sudo[91908]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791" returned: 0 in 0.869s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:33 devstack sudo[91918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7 1G
Jul 09 09:04:33 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:33 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f" returned: 0 in 0.825s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:33 devstack sudo[91920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602
Jul 09 09:04:33 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Flow 'volume_create_manager' (3df541e1-263a-4018-a1b9-13556994e5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319eb193-ba97-4a1b-812f-fd9904b143b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319eb193-ba97-4a1b-812f-fd9904b143b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1000139292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02403284-5ae3-4c29-8584-2fdecb93bee4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f9769fd147714e148c82ef4515e0816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=21ef4156-52d8-4fa5-b23e-327529a6d1ae,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:34Z,use_quota=True,user_id='507e76fa738d467a93fae7bf8d44845e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbb3390-9008-48d3-81a4-6f89b6c40158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbb3390-9008-48d3-81a4-6f89b6c40158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25739d5c-54ad-411a-b417-a894a523dc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25739d5c-54ad-411a-b417-a894a523dc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '02403284-5ae3-4c29-8584-2fdecb93bee4', 'volume_name': 'volume-02403284-5ae3-4c29-8584-2fdecb93bee4', 'volume_size': 1, 'source_volid': '21ef4156-52d8-4fa5-b23e-327529a6d1ae', 'source_volstatus': 'available'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2778c8d6-cd6a-4d17-b4e9-89ea1dd70750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2778c8d6-cd6a-4d17-b4e9-89ea1dd70750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88619887-83e8-4dbd-a212-4308b40f0ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:34 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Volume 02403284-5ae3-4c29-8584-2fdecb93bee4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-02403284-5ae3-4c29-8584-2fdecb93bee4', 'volume_size': 1, 'source_volid': '21ef4156-52d8-4fa5-b23e-327529a6d1ae', 'source_volstatus': 'available'}
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:34 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7 1G" returned: 0 in 0.868s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361e6c1a-956e-4297-a3c7-b15091e2a791 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:34 devstack sudo[91929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361e6c1a-956e-4297-a3c7-b15091e2a791 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7
Jul 09 09:04:34 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:34 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602" returned: 0 in 0.859s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:34 devstack sudo[91931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602
Jul 09 09:04:34 devstack sudo[91931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:35 devstack sudo[91931]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f.13bb2e01-961d-44ce-9fd4-c295bf31c602" returned: 0 in 0.732s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:35 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361e6c1a-956e-4297-a3c7-b15091e2a791 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7" returned: 0 in 0.815s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:35 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7 is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 09:04:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Lock "cinder-quobyte-13bb2e01-961d-44ce-9fd4-c295bf31c602" released by "_delete_snapshot" :: held 3.327s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Lock "cinder-quobyte-da420222-5c08-40ef-b408-52c1a2689f5f" released by "delete_snapshot" :: held 3.363s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:35 devstack sudo[91937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7
Jul 09 09:04:35 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:35 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Created reservations ['5defb784-e39d-4545-b7b4-f2ea4d485477', 'a4e88e4d-a905-4dc1-ba30-278e4c8fd9a7', '68311b44-ec9e-4470-bcf9-e0c2e60e47ea', '5a02e823-2b43-4a0f-a93d-2ea8f1ebbdc1'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:04:35 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Delete snapshot completed successfully.
Jul 09 09:04:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-941c0209-eaef-44a5-a325-3135ab4252ca tempest-VolumesExtendTest-217996883 None] Lock "cinder-13bb2e01-961d-44ce-9fd4-c295bf31c602-delete_snapshot" released by "delete_snapshot" :: held 3.550s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:36 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7" returned: 0 in 0.705s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:36 devstack sudo[91940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.info
Jul 09 09:04:36 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Acquiring lock "cinder-da420222-5c08-40ef-b408-52c1a2689f5f-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Lock "cinder-da420222-5c08-40ef-b408-52c1a2689f5f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Acquiring lock "cinder-quobyte-da420222-5c08-40ef-b408-52c1a2689f5f" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Lock "cinder-quobyte-da420222-5c08-40ef-b408-52c1a2689f5f" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:36 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f72c9be-f5e6-48ad-bac2-18263a4d69b5]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:36 devstack sudo[91943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f
Jul 09 09:04:36 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:36 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.info" returned: 0 in 0.824s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:36 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 09:04:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:36 devstack sudo[91951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.info
Jul 09 09:04:36 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:37 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f" returned: 0 in 0.917s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:37 devstack sudo[91967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f
Jul 09 09:04:37 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:37 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.info" returned: 0 in 0.743s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.940s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.319s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:37 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Cloning volume 21ef4156-52d8-4fa5-b23e-327529a6d1ae to volume 02403284-5ae3-4c29-8584-2fdecb93bee4
Jul 09 09:04:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Creating offline snapshot 93d4f0cf-686d-489b-bd59-be590367d91d of volume 21ef4156-52d8-4fa5-b23e-327529a6d1ae {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:04:37 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40c4b3b-aed4-46c6-96e0-d6aa117d1cf1]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:37 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-ecdd0fc3-5d35-435c-bce5-2dcdb4d25f72 tempest-GroupSnapshotsTest-1503641295 None] group_snapshot ba60230e-03e0-4747-b8b0-d78da9f6a7f2: created successfully
Jul 09 09:04:37 devstack sudo[91970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae
Jul 09 09:04:37 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:38 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-da420222-5c08-40ef-b408-52c1a2689f5f" returned: 0 in 0.683s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Lock "cinder-quobyte-da420222-5c08-40ef-b408-52c1a2689f5f" released by "delete_volume" :: held 1.678s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Created reservations ['16dab9f8-d9d8-499a-9596-1da670df3d6f', '3d929df3-054b-40cd-8c12-9fd0bc571b13', '4fb2bc2f-5088-4ecc-b018-17ddb3ad27f7', '50617006-b55c-47ef-bf05-deca89c8e87b'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:38 devstack sudo[91973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:04:38 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:38 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] group_snapshot ba60230e-03e0-4747-b8b0-d78da9f6a7f2: deleting
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] group_snapshot ba60230e-03e0-4747-b8b0-d78da9f6a7f2: deleting {{(pid=87009) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-361e6c1a-956e-4297-a3c7-b15091e2a791" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-361e6c1a-956e-4297-a3c7-b15091e2a791" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-5037578b-9dd7-4050-aac6-3fe43c2702b7" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-5037578b-9dd7-4050-aac6-3fe43c2702b7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:38 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Deleting offline snapshot 5037578b-9dd7-4050-aac6-3fe43c2702b7 of volume 361e6c1a-956e-4297-a3c7-b15091e2a791 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] snapshot_file for this snap is: volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae" returned: 0 in 1.014s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7fbc66-cbc8-4491-9192-8b88a873e840]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:38 devstack sudo[91979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d 1G
Jul 09 09:04:38 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:38 devstack sudo[91980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7
Jul 09 09:04:38 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:39 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.996s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:39 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:04:39 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Deleted volume successfully.
Jul 09 09:04:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-367b3e6c-403d-4c60-8747-179f573ca7a7 tempest-VolumesExtendTest-217996883 None] Lock "cinder-da420222-5c08-40ef-b408-52c1a2689f5f-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:39 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7" returned: 0 in 0.878s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-361e6c1a-956e-4297-a3c7-b15091e2a791(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:04:39 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd68121-c240-49bf-b468-a7c0a7f1649a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:39 devstack sudo[91991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791
Jul 09 09:04:39 devstack sudo[91991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:39 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d 1G" returned: 0 in 1.198s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:40 devstack sudo[91996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d
Jul 09 09:04:40 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:40 devstack sudo[91991]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791" returned: 0 in 1.218s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:40 devstack sudo[92026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7
Jul 09 09:04:40 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:41 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d" returned: 0 in 1.023s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:41 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d is being set with open permissions: ugo+rw
Jul 09 09:04:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:41 devstack sudo[92028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d
Jul 09 09:04:41 devstack sudo[92028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:41 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7" returned: 0 in 0.932s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:41 devstack sudo[92028]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d" returned: 0 in 0.873s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:41 devstack sudo[92036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7
Jul 09 09:04:41 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:41 devstack sudo[92038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.info
Jul 09 09:04:41 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:42 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791.5037578b-9dd7-4050-aac6-3fe43c2702b7" returned: 0 in 0.746s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-5037578b-9dd7-4050-aac6-3fe43c2702b7" released by "_delete_snapshot" :: held 3.935s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-361e6c1a-956e-4297-a3c7-b15091e2a791" released by "delete_snapshot" :: held 3.967s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:42 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.info" returned: 0 in 0.859s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:42 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.info is being set with open permissions: ugo+rw
Jul 09 09:04:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:42 devstack sudo[92061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.info
Jul 09 09:04:42 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:42 devstack cinder-volume[87009]: WARNING cinder.quota [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1207336556 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1207336556, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:04:42 devstack cinder-volume[87009]: WARNING cinder.quota [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1207336556 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1207336556, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:04:42 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] Created reservations ['2d27f0df-5264-4f7c-ace0-19476387c4d3', '7f990cc8-e19b-45c5-9ea7-4acf0d152c91', 'ffd82da3-bbc9-4b30-b405-348927242155', '016cebdc-ccb6-4337-87fb-c758fb562e82'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:04:43 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-9d4e2c77-72d0-4497-996e-8e988eeaf90e tempest-GroupSnapshotsTest-1503641295 None] group_snapshot ba60230e-03e0-4747-b8b0-d78da9f6a7f2: deleted successfully
Jul 09 09:04:43 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "cinder-quobyte-361e6c1a-956e-4297-a3c7-b15091e2a791" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.info" returned: 0 in 0.880s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-quobyte-02403284-5ae3-4c29-8584-2fdecb93bee4" by "_copy_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-02403284-5ae3-4c29-8584-2fdecb93bee4" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] snapshot: 93d4f0cf-686d-489b-bd59-be590367d91d, volume: 02403284-5ae3-4c29-8584-2fdecb93bee4,  {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-361e6c1a-956e-4297-a3c7-b15091e2a791" acquired by "delete_volume" :: waited 0.104s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9d49ea-d0cf-44ca-803d-e5b2b670dcba]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66bffee-c663-4810-9b5a-9874ac22c1c4]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:44 devstack sudo[92067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791
Jul 09 09:04:44 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:44 devstack sudo[92066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d
Jul 09 09:04:44 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:45 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d" returned: 0 in 1.400s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:04:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] will copy from snapshot at /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 09:04:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Creating direct copy from snapshot {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 09:04:45 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[824c193a-e56b-4b38-ab0e-ea9bdf6d54ce]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:45 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791" returned: 0 in 1.418s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:45 devstack sudo[92078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791
Jul 09 09:04:45 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:45 devstack sudo[92077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae
Jul 09 09:04:45 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:46 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-361e6c1a-956e-4297-a3c7-b15091e2a791" returned: 0 in 0.968s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Lock "cinder-quobyte-361e6c1a-956e-4297-a3c7-b15091e2a791" released by "delete_volume" :: held 2.494s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:46 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Created reservations ['8b76cc39-d70b-44b9-82dd-e3a15aa19877'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:04:46 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae" returned: 0 in 1.304s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:46 devstack cinder-volume[87009]: DEBUG cinder.utils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Path /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4 not found in is_blk_device check {{(pid=87009) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 09:04:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:46 devstack cinder-volume[87009]: WARNING cinder.quota [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1207336556 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1207336556, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:04:46 devstack sudo[92085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4
Jul 09 09:04:46 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:46 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Created reservations ['475cd3ab-162e-429d-b7ad-221adf2a5929', '082e2623-4bc4-4b1d-bdf9-424e6d655380', '6044e1a9-1d17-4e52-8504-c31856139468', '65b1c4bc-59c8-4c80-b82c-5450d8c3ba28'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:04:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:46 devstack sudo[92087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:04:46 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:47 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:04:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Flow 'volume_create_manager' (0fd30e3b-5328-4cb1-b104-2fb7dabebcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd097a9-97c6-4cef-bc20-db46988e6214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd097a9-97c6-4cef-bc20-db46988e6214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-741892895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b23e04-356b-4e43-b877-e84e3dd23cda,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd985600d45540cabbd9da52b2507338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:47Z,use_quota=True,user_id='39b7b1a9160948d0b4440338c6730464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b2e943-5b33-433f-b09b-e2088570a8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b2e943-5b33-433f-b09b-e2088570a8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f03e861-247e-42b1-81b3-4c303ec6ad88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f03e861-247e-42b1-81b3-4c303ec6ad88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76b23e04-356b-4e43-b877-e84e3dd23cda', 'volume_name': 'volume-76b23e04-356b-4e43-b877-e84e3dd23cda', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54558008-4d22-4138-b228-ef6ba7906722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54558008-4d22-4138-b228-ef6ba7906722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11de85ba-717b-4142-8aea-7f42bab324fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:47 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Volume 76b23e04-356b-4e43-b877-e84e3dd23cda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76b23e04-356b-4e43-b877-e84e3dd23cda', 'volume_size': 1}
Jul 09 09:04:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:47 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.974s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:47 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:04:47 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6d411325-7155-4c5e-aa1d-330d48b36cc3 tempest-GroupSnapshotsTest-1503641295 None] Delete group completed successfully.
Jul 09 09:04:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:04:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:54 devstack sudo[92120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:04:54 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:54 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4" returned: 0 in 8.022s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:54 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[af201c3c-1142-40f0-8a49-757a5afe11e1]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:54 devstack sudo[92122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae
Jul 09 09:04:54 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:55 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.890s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:04:55 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:04:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:04:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:04:55 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae" returned: 0 in 1.129s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:55 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Image conversion details: src /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae, size 1024.00 MB, duration 8.02 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4 {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:04:55 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Converted 1024.00 MB image at 127.61 MB/s
Jul 09 09:04:55 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4 is being set with open permissions: ugo+rw
Jul 09 09:04:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:55 devstack sudo[92142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4
Jul 09 09:04:55 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:56 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4" returned: 0 in 0.679s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-02403284-5ae3-4c29-8584-2fdecb93bee4" released by "_copy_volume_from_snapshot" :: held 12.683s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-quobyte-93d4f0cf-686d-489b-bd59-be590367d91d" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:04:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-93d4f0cf-686d-489b-bd59-be590367d91d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:04:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Deleting offline snapshot 93d4f0cf-686d-489b-bd59-be590367d91d of volume 21ef4156-52d8-4fa5-b23e-327529a6d1ae {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:04:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] snapshot_file for this snap is: volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:04:56 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1024c37-b953-40d9-8a11-ef0bb4680995]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:56 devstack sudo[92149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d
Jul 09 09:04:56 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:57 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=41,cinder:DELETE=1,cinder:SELECT=36,cinder:INSERT=10 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:04:57 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d" returned: 0 in 0.790s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:04:57 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[03106c69-0a01-4382-8728-1e95853f3817]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:04:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:57 devstack sudo[92154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae
Jul 09 09:04:57 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:57 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6f1b050f-e30c-455f-9b8c-7431c198c955 tempest-GroupSnapshotsV319Test-1227846466 None] Group tempest-GroupSnapshotsV319Test-Group-383426186: creating
Jul 09 09:04:57 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6f1b050f-e30c-455f-9b8c-7431c198c955 tempest-GroupSnapshotsV319Test-1227846466 None] Group tempest-GroupSnapshotsV319Test-Group-383426186: created successfully
Jul 09 09:04:57 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6f1b050f-e30c-455f-9b8c-7431c198c955 tempest-GroupSnapshotsV319Test-1227846466 None] Create group completed successfully.
Jul 09 09:04:58 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae" returned: 0 in 0.768s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:58 devstack sudo[92159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d
Jul 09 09:04:58 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:58 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d" returned: 0 in 0.732s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:58 devstack sudo[92165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d
Jul 09 09:04:58 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Flow 'volume_create_manager' (3b2c2748-a36a-47c2-8f39-690d96515c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9129d27-e65e-4f6b-a2f1-bd058dada49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9129d27-e65e-4f6b-a2f1-bd058dada49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1112117846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=108a9ebe-4bc6-4045-a2ed-13cd004f6f28,host='devstack@QuobyteHD#QuobyteHD',id=827bac43-57bc-4a4c-a044-df51a491e629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35bfab4797014d7dad92d19fae320e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:59Z,use_quota=True,user_id='6943668761f5448ca91494df321ce990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78f78d70-be35-451b-a1bd-43f983f46d08),volume_type_id=78f78d70-be35-451b-a1bd-43f983f46d08)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae563d6-a811-4adb-bf78-c27d05d6d475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:59 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae563d6-a811-4adb-bf78-c27d05d6d475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9564b5-0480-4eb9-82d2-87ccafe745cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9564b5-0480-4eb9-82d2-87ccafe745cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '827bac43-57bc-4a4c-a044-df51a491e629', 'volume_name': 'volume-827bac43-57bc-4a4c-a044-df51a491e629', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1c36ed-c714-4dc9-8f12-3c41285a0339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1c36ed-c714-4dc9-8f12-3c41285a0339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4de4f4-6293-462b-a834-13ff98dc2f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:59 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Volume 827bac43-57bc-4a4c-a044-df51a491e629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-827bac43-57bc-4a4c-a044-df51a491e629', 'volume_size': 1}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae.93d4f0cf-686d-489b-bd59-be590367d91d" returned: 0 in 0.687s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-93d4f0cf-686d-489b-bd59-be590367d91d" released by "_delete_snapshot" :: held 3.058s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.814s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.393s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-741892895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b23e04-356b-4e43-b877-e84e3dd23cda,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd985600d45540cabbd9da52b2507338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:47Z,use_quota=True,user_id='39b7b1a9160948d0b4440338c6730464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Creating volume 76b23e04-356b-4e43-b877-e84e3dd23cda {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:04:59 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-76b23e04-356b-4e43-b877-e84e3dd23cda 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88619887-83e8-4dbd-a212-4308b40f0ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02403284-5ae3-4c29-8584-2fdecb93bee4', 'volume_size': 1, 'source_volid': '21ef4156-52d8-4fa5-b23e-327529a6d1ae', 'source_volstatus': 'available'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:59 devstack sudo[92168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-76b23e04-356b-4e43-b877-e84e3dd23cda 1073741824
Jul 09 09:04:59 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd8dfce-9a3e-42dd-9d7e-6be48c6ed177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:04:59 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Volume volume-02403284-5ae3-4c29-8584-2fdecb93bee4 (02403284-5ae3-4c29-8584-2fdecb93bee4): created successfully
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd8dfce-9a3e-42dd-9d7e-6be48c6ed177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:04:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Flow 'volume_create_manager' (3df541e1-263a-4018-a1b9-13556994e5c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:04:59 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f519d82c-dbf3-413a-b5e0-a229eb49b8f6 tempest-VolumesGetTest-2043637563 None] Created volume successfully.
Jul 09 09:05:00 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-76b23e04-356b-4e43-b877-e84e3dd23cda 1073741824" returned: 0 in 0.823s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-76b23e04-356b-4e43-b877-e84e3dd23cda {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:00 devstack sudo[92174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-76b23e04-356b-4e43-b877-e84e3dd23cda
Jul 09 09:05:00 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:00 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:05:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Flow 'volume_create_manager' (40c81d09-97c0-459f-934b-a930ad6dfbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0fed56-b745-41f8-b982-063bf419a8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0fed56-b745-41f8-b982-063bf419a8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-620082282',display_name='tempest-VolumesGetTest-Volume-15916134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60112d30-dd0d-4838-b394-39f98917bb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9769fd147714e148c82ef4515e0816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:01Z,use_quota=True,user_id='507e76fa738d467a93fae7bf8d44845e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3a0385-f4ff-4c1c-afdc-d078edaf5d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3a0385-f4ff-4c1c-afdc-d078edaf5d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd25d744-818d-4a78-b28c-b9153234bbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd25d744-818d-4a78-b28c-b9153234bbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60112d30-dd0d-4838-b394-39f98917bb94', 'volume_name': 'volume-60112d30-dd0d-4838-b394-39f98917bb94', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3b6714-add2-4a0c-8390-bac248bcd777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3b6714-add2-4a0c-8390-bac248bcd777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32144232-027e-4783-84ff-7055790ace24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:01 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Volume 60112d30-dd0d-4838-b394-39f98917bb94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60112d30-dd0d-4838-b394-39f98917bb94', 'volume_size': 1}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:01 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-76b23e04-356b-4e43-b877-e84e3dd23cda" returned: 0 in 0.669s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.595s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=108a9ebe-4bc6-4045-a2ed-13cd004f6f28,created_at=2026-07-09T07:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1112117846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=108a9ebe-4bc6-4045-a2ed-13cd004f6f28,host='devstack@QuobyteHD#QuobyteHD',id=827bac43-57bc-4a4c-a044-df51a491e629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35bfab4797014d7dad92d19fae320e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:04:59Z,use_quota=True,user_id='6943668761f5448ca91494df321ce990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78f78d70-be35-451b-a1bd-43f983f46d08),volume_type_id=78f78d70-be35-451b-a1bd-43f983f46d08)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Creating volume 827bac43-57bc-4a4c-a044-df51a491e629 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:05:01 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:01 devstack sudo[92177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629 1073741824
Jul 09 09:05:01 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11de85ba-717b-4142-8aea-7f42bab324fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b23e04-356b-4e43-b877-e84e3dd23cda', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6f42aa-2253-4a2d-bb8a-f3c57bc9625c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:01 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Volume volume-76b23e04-356b-4e43-b877-e84e3dd23cda (76b23e04-356b-4e43-b877-e84e3dd23cda): created successfully
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6f42aa-2253-4a2d-bb8a-f3c57bc9625c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Flow 'volume_create_manager' (0fd30e3b-5328-4cb1-b104-2fb7dabebcfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:01 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e51f0763-a527-4120-9faa-2a3d7be419b3 tempest-VolumesListTestJSON-164196682 None] Created volume successfully.
Jul 09 09:05:01 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629 1073741824" returned: 0 in 0.828s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:01 devstack sudo[92183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629
Jul 09 09:05:01 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Flow 'volume_create_manager' (0b55954d-6b92-4f1c-b2f7-348bc711da37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7567b2-431f-489d-94f8-37bca0f850ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7567b2-431f-489d-94f8-37bca0f850ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-187298453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221a9236-cb7a-4632-a57e-2251d9bc379f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd985600d45540cabbd9da52b2507338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:02Z,use_quota=True,user_id='39b7b1a9160948d0b4440338c6730464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2d27bc-0101-4277-ac54-a010fbff83ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2d27bc-0101-4277-ac54-a010fbff83ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83ac2d4-935b-46cf-a6cb-942c8a578a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83ac2d4-935b-46cf-a6cb-942c8a578a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '221a9236-cb7a-4632-a57e-2251d9bc379f', 'volume_name': 'volume-221a9236-cb7a-4632-a57e-2251d9bc379f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81837bb2-54fd-4dc9-a4fa-289019300e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81837bb2-54fd-4dc9-a4fa-289019300e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ce2b1a-802c-4189-8756-f8d671acda0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:02 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Volume 221a9236-cb7a-4632-a57e-2251d9bc379f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-221a9236-cb7a-4632-a57e-2251d9bc379f', 'volume_size': 1}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:02 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629" returned: 0 in 0.652s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.550s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-620082282',display_name='tempest-VolumesGetTest-Volume-15916134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60112d30-dd0d-4838-b394-39f98917bb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9769fd147714e148c82ef4515e0816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:01Z,use_quota=True,user_id='507e76fa738d467a93fae7bf8d44845e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Creating volume 60112d30-dd0d-4838-b394-39f98917bb94 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:05:02 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-60112d30-dd0d-4838-b394-39f98917bb94 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4de4f4-6293-462b-a834-13ff98dc2f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827bac43-57bc-4a4c-a044-df51a491e629', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:02 devstack sudo[92189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-60112d30-dd0d-4838-b394-39f98917bb94 1073741824
Jul 09 09:05:02 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718e7c7f-8c7f-471f-92d9-71e339f07c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:02 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Volume volume-827bac43-57bc-4a4c-a044-df51a491e629 (827bac43-57bc-4a4c-a044-df51a491e629): created successfully
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718e7c7f-8c7f-471f-92d9-71e339f07c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Flow 'volume_create_manager' (3b2c2748-a36a-47c2-8f39-690d96515c2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:02 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6bed104d-09d7-491a-97c2-8f9244d431b4 tempest-GroupSnapshotsV319Test-1227846466 None] Created volume successfully.
Jul 09 09:05:03 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] GroupSnapshot 976350f2-e27c-4caa-aafc-283b4ef811a0: creating.
Jul 09 09:05:03 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] Group snapshot 976350f2-e27c-4caa-aafc-283b4ef811a0: creating. {{(pid=87009) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 09 09:05:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:03 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-60112d30-dd0d-4838-b394-39f98917bb94 1073741824" returned: 0 in 0.911s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-60112d30-dd0d-4838-b394-39f98917bb94 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:03 devstack sudo[92195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-60112d30-dd0d-4838-b394-39f98917bb94
Jul 09 09:05:03 devstack sudo[92195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:04 devstack sudo[92195]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-60112d30-dd0d-4838-b394-39f98917bb94" returned: 0 in 0.663s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.654s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-187298453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221a9236-cb7a-4632-a57e-2251d9bc379f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd985600d45540cabbd9da52b2507338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:02Z,use_quota=True,user_id='39b7b1a9160948d0b4440338c6730464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Creating volume 221a9236-cb7a-4632-a57e-2251d9bc379f {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:05:04 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-221a9236-cb7a-4632-a57e-2251d9bc379f 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32144232-027e-4783-84ff-7055790ace24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60112d30-dd0d-4838-b394-39f98917bb94', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:04 devstack sudo[92198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-221a9236-cb7a-4632-a57e-2251d9bc379f 1073741824
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101d6d94-0415-4909-b62a-20f49c39f35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:04 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:04 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Volume volume-60112d30-dd0d-4838-b394-39f98917bb94 (60112d30-dd0d-4838-b394-39f98917bb94): created successfully
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101d6d94-0415-4909-b62a-20f49c39f35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:04 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Flow 'volume_create_manager' (40c81d09-97c0-459f-934b-a930ad6dfbfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:04 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-793519bd-5041-4331-9b1e-c808fc87ef1f tempest-VolumesGetTest-2043637563 None] Created volume successfully.
Jul 09 09:05:05 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-221a9236-cb7a-4632-a57e-2251d9bc379f 1073741824" returned: 0 in 0.796s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-221a9236-cb7a-4632-a57e-2251d9bc379f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:05 devstack sudo[92204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-221a9236-cb7a-4632-a57e-2251d9bc379f
Jul 09 09:05:05 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-60112d30-dd0d-4838-b394-39f98917bb94-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Lock "cinder-60112d30-dd0d-4838-b394-39f98917bb94-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-quobyte-60112d30-dd0d-4838-b394-39f98917bb94" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-60112d30-dd0d-4838-b394-39f98917bb94" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[621f5d84-2db5-4f73-b8a4-814399d09930]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-60112d30-dd0d-4838-b394-39f98917bb94 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:05 devstack sudo[92206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-60112d30-dd0d-4838-b394-39f98917bb94
Jul 09 09:05:05 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:05 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-221a9236-cb7a-4632-a57e-2251d9bc379f" returned: 0 in 0.666s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.542s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ce2b1a-802c-4189-8756-f8d671acda0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-221a9236-cb7a-4632-a57e-2251d9bc379f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef2c1bd-d136-4f8a-bbb5-1ff05b294731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] Creating offline snapshot ebb281cb-617f-4921-98aa-0d6f26b8972f of volume 827bac43-57bc-4a4c-a044-df51a491e629 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:05:05 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Volume volume-221a9236-cb7a-4632-a57e-2251d9bc379f (221a9236-cb7a-4632-a57e-2251d9bc379f): created successfully
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef2c1bd-d136-4f8a-bbb5-1ff05b294731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Flow 'volume_create_manager' (0b55954d-6b92-4f1c-b2f7-348bc711da37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3bac39-0e44-4a9a-b8a8-b8153eb8aed8]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:05 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-c2d0cd26-fa09-4779-9d73-8a03d9c2e986 tempest-VolumesListTestJSON-164196682 None] Created volume successfully.
Jul 09 09:05:05 devstack sudo[92209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629
Jul 09 09:05:05 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:06 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-60112d30-dd0d-4838-b394-39f98917bb94" returned: 0 in 0.736s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-60112d30-dd0d-4838-b394-39f98917bb94 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:06 devstack sudo[92214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-60112d30-dd0d-4838-b394-39f98917bb94
Jul 09 09:05:06 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:06 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629" returned: 0 in 0.768s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:06 devstack sudo[92219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f 1G
Jul 09 09:05:06 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:06 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-60112d30-dd0d-4838-b394-39f98917bb94" returned: 0 in 0.653s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-60112d30-dd0d-4838-b394-39f98917bb94" released by "delete_volume" :: held 1.452s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:06 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Created reservations ['0966f5d9-b749-4abc-96e9-aff26ebb724f', 'ae904e4c-0dff-4dd6-99b1-bd6af1601e0a', 'f32e4283-9280-4668-b5df-711854c1cb87', '1f3c3613-c8b2-410a-a6b1-f9b63d4a5791'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:05:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:06 devstack sudo[92222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:05:06 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Flow 'volume_create_manager' (8a9cf9c1-aec3-42f2-aeb4-adb42c2b66b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70022754-7ee5-43e6-9e42-7fab1c6b77da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70022754-7ee5-43e6-9e42-7fab1c6b77da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1969366072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240527e1-8fef-4913-a732-b726efb5f4b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd985600d45540cabbd9da52b2507338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:07Z,use_quota=True,user_id='39b7b1a9160948d0b4440338c6730464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3217dee0-fbfb-4e92-b721-43e2727e3838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3217dee0-fbfb-4e92-b721-43e2727e3838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49678ea2-7ecd-420e-a2da-0458b040c887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49678ea2-7ecd-420e-a2da-0458b040c887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240527e1-8fef-4913-a732-b726efb5f4b2', 'volume_name': 'volume-240527e1-8fef-4913-a732-b726efb5f4b2', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4060d94f-28c4-4aef-bb27-4840d8c49ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4060d94f-28c4-4aef-bb27-4840d8c49ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd509f4-3ab1-4365-8ae6-c304104a229a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:07 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Volume 240527e1-8fef-4913-a732-b726efb5f4b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240527e1-8fef-4913-a732-b726efb5f4b2', 'volume_size': 1}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:07 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f 1G" returned: 0 in 0.862s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-827bac43-57bc-4a4c-a044-df51a491e629 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:07 devstack sudo[92228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-827bac43-57bc-4a4c-a044-df51a491e629 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f
Jul 09 09:05:07 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-02403284-5ae3-4c29-8584-2fdecb93bee4-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Lock "cinder-02403284-5ae3-4c29-8584-2fdecb93bee4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:07 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.723s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:05:07 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Deleted volume successfully.
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-quobyte-02403284-5ae3-4c29-8584-2fdecb93bee4" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b2c272d5-0612-4f35-9271-ebb5ef536509 tempest-VolumesGetTest-2043637563 None] Lock "cinder-60112d30-dd0d-4838-b394-39f98917bb94-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-02403284-5ae3-4c29-8584-2fdecb93bee4" acquired by "delete_volume" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f4d85a-5b9d-443e-bb50-c565da2d569a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:07 devstack sudo[92231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4
Jul 09 09:05:07 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:08 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-827bac43-57bc-4a4c-a044-df51a491e629 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f" returned: 0 in 0.750s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:08 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 09:05:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:08 devstack sudo[92239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f
Jul 09 09:05:08 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:08 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4" returned: 0 in 0.811s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:08 devstack sudo[92245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4
Jul 09 09:05:08 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:08 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f" returned: 0 in 0.706s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:08 devstack sudo[92253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.info
Jul 09 09:05:08 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:09 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-02403284-5ae3-4c29-8584-2fdecb93bee4" returned: 0 in 0.673s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-02403284-5ae3-4c29-8584-2fdecb93bee4" released by "delete_volume" :: held 1.534s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:09 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Created reservations ['94412985-6669-4476-85cf-dd93ef73c3a4', 'd280070c-0d29-4d36-b90c-852246fc6a5b', '9fb5ed09-b03b-4ded-85e8-9f4d64a85ae3', '2ccf1c7f-1608-48c2-a728-966594a558fb'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:05:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:09 devstack sudo[92256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:05:09 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:09 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.info" returned: 0 in 0.671s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:09 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 09 09:05:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:09 devstack sudo[92259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.info
Jul 09 09:05:09 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-21ef4156-52d8-4fa5-b23e-327529a6d1ae-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Lock "cinder-21ef4156-52d8-4fa5-b23e-327529a6d1ae-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-quobyte-21ef4156-52d8-4fa5-b23e-327529a6d1ae" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:10 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-21ef4156-52d8-4fa5-b23e-327529a6d1ae" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.690s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:05:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Deleted volume successfully.
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f25b73-4725-49f6-98ef-dfa6c3927bd7]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-63a9aefb-9f07-43fe-873c-1d0c00d931bb tempest-VolumesGetTest-2043637563 None] Lock "cinder-02403284-5ae3-4c29-8584-2fdecb93bee4-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:10 devstack sudo[92262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae
Jul 09 09:05:10 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:10 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.info" returned: 0 in 0.737s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.624s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1969366072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240527e1-8fef-4913-a732-b726efb5f4b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fd985600d45540cabbd9da52b2507338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:07Z,use_quota=True,user_id='39b7b1a9160948d0b4440338c6730464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Creating volume 240527e1-8fef-4913-a732-b726efb5f4b2 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:05:10 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-240527e1-8fef-4913-a732-b726efb5f4b2 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:10 devstack sudo[92265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-240527e1-8fef-4913-a732-b726efb5f4b2 1073741824
Jul 09 09:05:10 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-35c2ac1c-0976-4938-876b-172d690ff3ef tempest-GroupSnapshotsV319Test-1227846466 None] group_snapshot 976350f2-e27c-4caa-aafc-283b4ef811a0: created successfully
Jul 09 09:05:10 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae" returned: 0 in 0.833s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] group_snapshot 976350f2-e27c-4caa-aafc-283b4ef811a0: deleting
Jul 09 09:05:10 devstack sudo[92270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae
Jul 09 09:05:10 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] group_snapshot 976350f2-e27c-4caa-aafc-283b4ef811a0: deleting {{(pid=87009) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Acquiring lock "cinder-quobyte-827bac43-57bc-4a4c-a044-df51a491e629" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Lock "cinder-quobyte-827bac43-57bc-4a4c-a044-df51a491e629" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Acquiring lock "cinder-quobyte-ebb281cb-617f-4921-98aa-0d6f26b8972f" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Lock "cinder-quobyte-ebb281cb-617f-4921-98aa-0d6f26b8972f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Deleting offline snapshot ebb281cb-617f-4921-98aa-0d6f26b8972f of volume 827bac43-57bc-4a4c-a044-df51a491e629 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] snapshot_file for this snap is: volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfe2885-93da-4c66-8135-dcb3f9138723]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:11 devstack sudo[92275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f
Jul 09 09:05:11 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:11 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-240527e1-8fef-4913-a732-b726efb5f4b2 1073741824" returned: 0 in 1.076s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-240527e1-8fef-4913-a732-b726efb5f4b2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:11 devstack sudo[92278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-240527e1-8fef-4913-a732-b726efb5f4b2
Jul 09 09:05:11 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:11 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-21ef4156-52d8-4fa5-b23e-327529a6d1ae" returned: 0 in 0.777s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-21ef4156-52d8-4fa5-b23e-327529a6d1ae" released by "delete_volume" :: held 1.694s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Created reservations ['6bd98926-cac2-4b91-91c4-82fc1afe4cb7', '44fbbf70-1541-41d3-88b9-c92e840f24ea', 'a27d0a97-1a79-4647-af94-7fd8a53a0796', 'e4c8b3e4-5ca7-4e65-8de1-8b8710c91b74'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:11 devstack sudo[92292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:05:11 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:12 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-65988c59-a191-4b1f-82f6-4ddb6984186d req-f0ddfede-930b-45a4-bf68-037515ae7797 tempest-ServerActionsTestOtherA-1511266625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f" returned: 0 in 0.921s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-827bac43-57bc-4a4c-a044-df51a491e629(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1087ce-26e7-4ca3-805a-a22c45ffeb86]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:12 devstack sudo[92294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629
Jul 09 09:05:12 devstack sudo[92294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:12 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-240527e1-8fef-4913-a732-b726efb5f4b2" returned: 0 in 0.709s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-65988c59-a191-4b1f-82f6-4ddb6984186d req-f0ddfede-930b-45a4-bf68-037515ae7797 tempest-ServerActionsTestOtherA-1511266625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.185s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd509f4-3ab1-4365-8ae6-c304104a229a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240527e1-8fef-4913-a732-b726efb5f4b2', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee4c0a5-07be-4308-af74-7ae0ddbc5725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2201369-68b1-418a-9846-5b17621f3d98]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-65988c59-a191-4b1f-82f6-4ddb6984186d req-f0ddfede-930b-45a4-bf68-037515ae7797 tempest-ServerActionsTestOtherA-1511266625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:12 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Volume volume-240527e1-8fef-4913-a732-b726efb5f4b2 (240527e1-8fef-4913-a732-b726efb5f4b2): created successfully
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee4c0a5-07be-4308-af74-7ae0ddbc5725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Flow 'volume_create_manager' (8a9cf9c1-aec3-42f2-aeb4-adb42c2b66b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:12 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-260fe611-edb7-4435-9ec2-30b43ec2292c tempest-VolumesListTestJSON-164196682 None] Created volume successfully.
Jul 09 09:05:12 devstack sudo[92297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb
Jul 09 09:05:12 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:12 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.776s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:05:12 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Deleted volume successfully.
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-37c1496a-06e5-4d1e-9bb8-0c36d2ab03f5 tempest-VolumesGetTest-2043637563 None] Lock "cinder-21ef4156-52d8-4fa5-b23e-327529a6d1ae-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:12 devstack sudo[92294]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629" returned: 0 in 0.860s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:12 devstack sudo[92304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f
Jul 09 09:05:12 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Flow 'volume_create_manager' (ef1b9745-e412-4a85-bc30-e7049ee8e126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d393fb45-e869-44e8-a19e-239238b3ef3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d393fb45-e869-44e8-a19e-239238b3ef3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-636480812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ff9885-711d-4c78-ad24-02246ef3b306,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f9769fd147714e148c82ef4515e0816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:13Z,use_quota=True,user_id='507e76fa738d467a93fae7bf8d44845e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf596e3-0b4f-4d8a-8a0d-ea062fd34b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf596e3-0b4f-4d8a-8a0d-ea062fd34b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754f22d6-b246-43c4-9ca6-ed141695a5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG cinder.image.glance [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Creating Keystone auth plugin from conf {{(pid=87009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 09:05:13 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-65988c59-a191-4b1f-82f6-4ddb6984186d req-f0ddfede-930b-45a4-bf68-037515ae7797 tempest-ServerActionsTestOtherA-1511266625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb" returned: 0 in 1.021s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-65988c59-a191-4b1f-82f6-4ddb6984186d req-f0ddfede-930b-45a4-bf68-037515ae7797 tempest-ServerActionsTestOtherA-1511266625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.076s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-65988c59-a191-4b1f-82f6-4ddb6984186d req-f0ddfede-930b-45a4-bf68-037515ae7797 tempest-ServerActionsTestOtherA-1511266625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6700ea4c-43ee-45f3-b282-d62cd8775da1', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:05:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-65988c59-a191-4b1f-82f6-4ddb6984186d req-f0ddfede-930b-45a4-bf68-037515ae7797 tempest-ServerActionsTestOtherA-1511266625 None] attachment_update completed successfully.
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754f22d6-b246-43c4-9ca6-ed141695a5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '27ff9885-711d-4c78-ad24-02246ef3b306', 'volume_name': 'volume-27ff9885-711d-4c78-ad24-02246ef3b306', 'volume_size': 1, 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a39f8923563f40339681d0ff8d3f26a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'created_at': datetime.datetime(2026, 7, 9, 6, 52, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 6, 52, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/769ece37-1cae-43d1-b0fa-7053cc01926f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a5e26f0>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a65c53-f093-48fa-8715-c9631b5e986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a65c53-f093-48fa-8715-c9631b5e986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50df839-4700-4d5c-aac4-9d9903b24262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:13 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Volume 27ff9885-711d-4c78-ad24-02246ef3b306: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-27ff9885-711d-4c78-ad24-02246ef3b306', 'volume_size': 1, 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a39f8923563f40339681d0ff8d3f26a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'created_at': datetime.datetime(2026, 7, 9, 6, 52, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 6, 52, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/769ece37-1cae-43d1-b0fa-7053cc01926f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a5e26f0>}
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Trying to clone 27ff9885-711d-4c78-ad24-02246ef3b306 from image 769ece37-1cae-43d1-b0fa-7053cc01926f at location (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]). {{(pid=87009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 09:05:13 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f" returned: 0 in 1.056s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:13 devstack sudo[92415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f
Jul 09 09:05:14 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:14 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_sh5747s5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 09:05:14 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Image download 20.69 MB at 20.69 MB/s
Jul 09 09:05:14 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4627d28-24dd-453a-8e8b-7653af5de217]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_sh5747s5devstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:14 devstack sudo[92418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_sh5747s5devstack@QuobyteHD
Jul 09 09:05:14 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:14 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629.ebb281cb-617f-4921-98aa-0d6f26b8972f" returned: 0 in 0.876s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Lock "cinder-quobyte-ebb281cb-617f-4921-98aa-0d6f26b8972f" released by "_delete_snapshot" :: held 3.822s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Lock "cinder-quobyte-827bac43-57bc-4a4c-a044-df51a491e629" released by "delete_snapshot" :: held 3.855s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:14 devstack cinder-volume[87009]: WARNING cinder.quota [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-5116349 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-5116349, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:05:14 devstack cinder-volume[87009]: WARNING cinder.quota [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-5116349 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-5116349, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:05:14 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] Created reservations ['a55c4337-a66e-4f45-a202-966e69c0b3ba', '5a0d59d2-832a-49e1-b28e-c00fcaee2dc9', '204b92a7-fc10-4923-9899-cb0d4d627116', '422d73ca-4df2-4b4c-85e2-818ba5724b7b'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:05:15 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_sh5747s5devstack@QuobyteHD" returned: 0 in 0.814s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Temporary image 769ece37-1cae-43d1-b0fa-7053cc01926f is fetched for user 507e76fa738d467a93fae7bf8d44845e. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 09:05:15 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-8805749f-10ac-4915-ab03-25e50c77a9c5 tempest-GroupSnapshotsV319Test-1227846466 None] group_snapshot 976350f2-e27c-4caa-aafc-283b4ef811a0: deleted successfully
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc36b11-61a9-414e-95fb-ecfe62205bef]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_sh5747s5devstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:15 devstack sudo[92739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_sh5747s5devstack@QuobyteHD
Jul 09 09:05:15 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Acquiring lock "cinder-240527e1-8fef-4913-a732-b726efb5f4b2-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Lock "cinder-240527e1-8fef-4913-a732-b726efb5f4b2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Acquiring lock "cinder-quobyte-240527e1-8fef-4913-a732-b726efb5f4b2" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Acquiring lock "cinder-quobyte-827bac43-57bc-4a4c-a044-df51a491e629" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Lock "cinder-quobyte-240527e1-8fef-4913-a732-b726efb5f4b2" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Lock "cinder-quobyte-827bac43-57bc-4a4c-a044-df51a491e629" acquired by "delete_volume" :: waited 0.035s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[301a265f-01d7-4637-a069-0ed0e5f25009]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-240527e1-8fef-4913-a732-b726efb5f4b2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b503e19e-ae6a-44b0-aba2-5c45c662062d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:15 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_sh5747s5devstack@QuobyteHD" returned: 0 in 0.772s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-636480812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ff9885-711d-4c78-ad24-02246ef3b306,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f9769fd147714e148c82ef4515e0816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:13Z,use_quota=True,user_id='507e76fa738d467a93fae7bf8d44845e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Creating volume 27ff9885-711d-4c78-ad24-02246ef3b306 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:05:15 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:05:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:15 devstack sudo[92746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306 1073741824
Jul 09 09:05:15 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:15 devstack sudo[92744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-240527e1-8fef-4913-a732-b726efb5f4b2
Jul 09 09:05:15 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:15 devstack sudo[92745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629
Jul 09 09:05:15 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:16 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629" returned: 0 in 0.796s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:16 devstack sudo[92760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629
Jul 09 09:05:16 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:16 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-240527e1-8fef-4913-a732-b726efb5f4b2" returned: 0 in 0.852s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-240527e1-8fef-4913-a732-b726efb5f4b2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:16 devstack sudo[92762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-240527e1-8fef-4913-a732-b726efb5f4b2
Jul 09 09:05:16 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:16 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306 1073741824" returned: 0 in 0.946s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:16 devstack sudo[92764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306
Jul 09 09:05:16 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:17 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-827bac43-57bc-4a4c-a044-df51a491e629" returned: 0 in 0.736s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Lock "cinder-quobyte-827bac43-57bc-4a4c-a044-df51a491e629" released by "delete_volume" :: held 1.606s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Created reservations ['0436129f-eecd-49ce-8237-575bd5dc0e0d'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:05:17 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-240527e1-8fef-4913-a732-b726efb5f4b2" returned: 0 in 0.830s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Lock "cinder-quobyte-240527e1-8fef-4913-a732-b726efb5f4b2" released by "delete_volume" :: held 1.758s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:17 devstack cinder-volume[87009]: WARNING cinder.quota [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-5116349 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-5116349, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Created reservations ['40b253e6-8cd7-43df-b6e0-f0367cfbd7db', 'f519bf8b-94b1-43cc-a919-6093c878f1e2', '7d1f80f3-6694-4ebe-a820-9fc3c56c7737', '3034ea83-cdeb-4ffd-8a19-32ce4acd01ba'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Created reservations ['0eb37973-87db-4049-93d8-5195bdc2268c', '5a2a8317-fca9-4a29-ab91-6927854bd428', '31f35337-cc6b-45cd-96cb-b01d98520447', '0b06403f-d95e-4688-9db6-8d893c3d7b55'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:05:17 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306" returned: 0 in 0.819s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:17 devstack sudo[92770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:17 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:17 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Attempting download of 769ece37-1cae-43d1-b0fa-7053cc01926f ((None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}])) to volume 27ff9885-711d-4c78-ad24-02246ef3b306. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 09:05:17 devstack sudo[92772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:05:17 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:18 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[705cdf34-34c7-4b39-98f7-ed4e29ceb99b]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f__c5l2tjb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Acquiring lock "cinder-221a9236-cb7a-4632-a57e-2251d9bc379f-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Lock "cinder-221a9236-cb7a-4632-a57e-2251d9bc379f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Acquiring lock "cinder-quobyte-221a9236-cb7a-4632-a57e-2251d9bc379f" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Lock "cinder-quobyte-221a9236-cb7a-4632-a57e-2251d9bc379f" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:18 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[433abbd2-63aa-40cb-a8a4-179df65e4781]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-221a9236-cb7a-4632-a57e-2251d9bc379f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:18 devstack sudo[92774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f__c5l2tjb
Jul 09 09:05:18 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:18 devstack sudo[92775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-221a9236-cb7a-4632-a57e-2251d9bc379f
Jul 09 09:05:18 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:18 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.861s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:18 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:05:18 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Deleted volume successfully.
Jul 09 09:05:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2a03dbd1-53bc-416c-83ef-4b88fc86eac3 tempest-VolumesListTestJSON-164196682 None] Lock "cinder-240527e1-8fef-4913-a732-b726efb5f4b2-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:19 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.236s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:19 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:05:19 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f285cb54-e233-4e21-99d3-378461d33513 tempest-GroupSnapshotsV319Test-1227846466 None] Delete group completed successfully.
Jul 09 09:05:19 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f__c5l2tjb" returned: 0 in 1.334s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f__c5l2tjb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:19 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-221a9236-cb7a-4632-a57e-2251d9bc379f" returned: 0 in 1.211s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-221a9236-cb7a-4632-a57e-2251d9bc379f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:19 devstack sudo[92789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f__c5l2tjb
Jul 09 09:05:19 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:19 devstack sudo[92791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-221a9236-cb7a-4632-a57e-2251d9bc379f
Jul 09 09:05:19 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:20 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f__c5l2tjb" returned: 1 in 0.779s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f__c5l2tjb' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:05:20 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b00d74-82bb-4696-b350-813d00b3fb92]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_sh5747s5devstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:20 devstack sudo[92798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_sh5747s5devstack@QuobyteHD
Jul 09 09:05:20 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:20 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-221a9236-cb7a-4632-a57e-2251d9bc379f" returned: 0 in 0.802s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Lock "cinder-quobyte-221a9236-cb7a-4632-a57e-2251d9bc379f" released by "delete_volume" :: held 2.099s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:20 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Created reservations ['699f54d9-86ce-4c6f-b08d-872fff6b65bb', 'f3efb2ed-1892-4679-9dd9-a7f29e0384a8', '0fd5d2cd-8914-4414-957d-befa9971e2a0', '7c5fe6a1-a1a9-4840-a686-3a65b56dd869'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:05:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:20 devstack sudo[92800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:05:20 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:21 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_sh5747s5devstack@QuobyteHD" returned: 0 in 0.908s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:21 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] 769ece37-1cae-43d1-b0fa-7053cc01926f was qcow2, converting to raw {{(pid=87009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 09:05:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_sh5747s5devstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:21 devstack sudo[92813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_sh5747s5devstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306
Jul 09 09:05:21 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:21 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.843s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:21 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:05:21 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Deleted volume successfully.
Jul 09 09:05:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-942e249d-5425-464f-a5d7-e6968b5e1d4c tempest-VolumesListTestJSON-164196682 None] Lock "cinder-221a9236-cb7a-4632-a57e-2251d9bc379f-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:21 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-a08a2977-008f-4109-9948-52af6213a89d req-14934a58-8a2b-4e1b-9098-c26b0c07bb4f tempest-ServerActionsTestOtherA-1511266625 None] Terminate volume connection completed successfully.
Jul 09 09:05:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-a08a2977-008f-4109-9948-52af6213a89d req-14934a58-8a2b-4e1b-9098-c26b0c07bb4f tempest-ServerActionsTestOtherA-1511266625 None] Deleting attachment 6700ea4c-43ee-45f3-b282-d62cd8775da1. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:05:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Acquiring lock "cinder-76b23e04-356b-4e43-b877-e84e3dd23cda-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Lock "cinder-76b23e04-356b-4e43-b877-e84e3dd23cda-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Acquiring lock "cinder-quobyte-76b23e04-356b-4e43-b877-e84e3dd23cda" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Lock "cinder-quobyte-76b23e04-356b-4e43-b877-e84e3dd23cda" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:21 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac223ed6-2aa7-42d6-ba50-3ed068f23093]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-76b23e04-356b-4e43-b877-e84e3dd23cda {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:21 devstack sudo[92842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-76b23e04-356b-4e43-b877-e84e3dd23cda
Jul 09 09:05:21 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:22 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-76b23e04-356b-4e43-b877-e84e3dd23cda" returned: 0 in 1.142s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-76b23e04-356b-4e43-b877-e84e3dd23cda {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:22 devstack sudo[92872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-76b23e04-356b-4e43-b877-e84e3dd23cda
Jul 09 09:05:22 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:23 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-76b23e04-356b-4e43-b877-e84e3dd23cda" returned: 0 in 0.946s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Lock "cinder-quobyte-76b23e04-356b-4e43-b877-e84e3dd23cda" released by "delete_volume" :: held 2.162s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:23 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_sh5747s5devstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306" returned: 0 in 2.755s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:23 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_sh5747s5devstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306 {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:05:23 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Converted 112.00 MB image at 40.64 MB/s
Jul 09 09:05:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:23 devstack sudo[92881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306 1G
Jul 09 09:05:23 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:23 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Created reservations ['baec3d3d-3ae0-4af0-a7e9-4b74913129af', '043e4eec-3187-4754-bdd1-ccf4a9d0d0f6', 'cfc5ab54-13a5-443a-92c7-899d8f44ac48', '83140d3a-8c28-4dec-a09f-5c14315c9060'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:05:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:24 devstack sudo[92891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:05:24 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-a08a2977-008f-4109-9948-52af6213a89d req-d9d11203-f2e1-4a94-9f1d-7b21032f8388 tempest-ServerActionsTestOtherA-1511266625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-a08a2977-008f-4109-9948-52af6213a89d req-d9d11203-f2e1-4a94-9f1d-7b21032f8388 tempest-ServerActionsTestOtherA-1511266625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:24 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4c7796-4d2f-4227-9d49-9c42abc47482]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-a08a2977-008f-4109-9948-52af6213a89d req-d9d11203-f2e1-4a94-9f1d-7b21032f8388 tempest-ServerActionsTestOtherA-1511266625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:24 devstack sudo[92893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb
Jul 09 09:05:24 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:24 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306 1G" returned: 0 in 0.854s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:24 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad006b0-3b02-4842-ac28-07ad3d36f239]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:24 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.795s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:24 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:05:24 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Deleted volume successfully.
Jul 09 09:05:24 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5a400562-8d5c-4978-beb6-221e4ef38203 tempest-VolumesListTestJSON-164196682 None] Lock "cinder-76b23e04-356b-4e43-b877-e84e3dd23cda-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:24 devstack sudo[92899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306
Jul 09 09:05:24 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:25 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-a08a2977-008f-4109-9948-52af6213a89d req-d9d11203-f2e1-4a94-9f1d-7b21032f8388 tempest-ServerActionsTestOtherA-1511266625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb" returned: 0 in 0.935s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-a08a2977-008f-4109-9948-52af6213a89d req-d9d11203-f2e1-4a94-9f1d-7b21032f8388 tempest-ServerActionsTestOtherA-1511266625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.965s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-a08a2977-008f-4109-9948-52af6213a89d req-d9d11203-f2e1-4a94-9f1d-7b21032f8388 tempest-ServerActionsTestOtherA-1511266625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b076df2-514a-4e75-abc2-fec30d7b78a6', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:05:25 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-a08a2977-008f-4109-9948-52af6213a89d req-d9d11203-f2e1-4a94-9f1d-7b21032f8388 tempest-ServerActionsTestOtherA-1511266625 None] attachment_update completed successfully.
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Flow 'volume_create_manager' (3a852c13-e213-4107-b97a-ec71c23e94c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8467963-2e40-4162-b14d-53a6fdce01ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8467963-2e40-4162-b14d-53a6fdce01ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-110731346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91912c1-f95d-4ab1-ad41-b6826bc49c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f40d13e43fd475e819f33d367f2952d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:25Z,use_quota=True,user_id='d363d295efd744bfae52c089bfa07469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aba7786-f96d-4635-ab94-ee48fc38bd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aba7786-f96d-4635-ab94-ee48fc38bd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29111ab-4383-4067-9169-42005dd812d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29111ab-4383-4067-9169-42005dd812d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e91912c1-f95d-4ab1-ad41-b6826bc49c39', 'volume_name': 'volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cf22af-6498-4448-bb6f-55fa9e8d2f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cf22af-6498-4448-bb6f-55fa9e8d2f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6ab5e0-50d6-431f-8892-24d403c79b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:25 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Volume e91912c1-f95d-4ab1-ad41-b6826bc49c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39', 'volume_size': 1}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-110731346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91912c1-f95d-4ab1-ad41-b6826bc49c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f40d13e43fd475e819f33d367f2952d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:25Z,use_quota=True,user_id='d363d295efd744bfae52c089bfa07469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Creating volume e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:05:25 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:25 devstack sudo[92905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39 1073741824
Jul 09 09:05:25 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:25 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306" returned: 0 in 0.914s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:25 devstack sudo[92909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306
Jul 09 09:05:25 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:26 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39 1073741824" returned: 0 in 0.984s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:26 devstack sudo[92929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39
Jul 09 09:05:26 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:26 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306" returned: 1 in 0.911s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:05:26 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Downloaded image 769ece37-1cae-43d1-b0fa-7053cc01926f ((None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}])) to volume 27ff9885-711d-4c78-ad24-02246ef3b306 successfully. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 09:05:26 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Temporary image 769ece37-1cae-43d1-b0fa-7053cc01926f for user 507e76fa738d467a93fae7bf8d44845e is deleted. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 09:05:26 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Marking volume 27ff9885-711d-4c78-ad24-02246ef3b306 as bootable. {{(pid=87009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 09:05:26 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Copying metadata from image 769ece37-1cae-43d1-b0fa-7053cc01926f to 27ff9885-711d-4c78-ad24-02246ef3b306. {{(pid=87009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 09:05:26 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Creating volume glance metadata for volume 27ff9885-711d-4c78-ad24-02246ef3b306 backed by image 769ece37-1cae-43d1-b0fa-7053cc01926f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 09:05:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50df839-4700-4d5c-aac4-9d9903b24262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27ff9885-711d-4c78-ad24-02246ef3b306', 'volume_size': 1, 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a39f8923563f40339681d0ff8d3f26a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'created_at': datetime.datetime(2026, 7, 9, 6, 52, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 6, 52, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/769ece37-1cae-43d1-b0fa-7053cc01926f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a5e26f0>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062e74e7-f1d2-4de7-8d91-848af77a702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:26 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Volume volume-27ff9885-711d-4c78-ad24-02246ef3b306 (27ff9885-711d-4c78-ad24-02246ef3b306): created successfully
Jul 09 09:05:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062e74e7-f1d2-4de7-8d91-848af77a702d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Flow 'volume_create_manager' (ef1b9745-e412-4a85-bc30-e7049ee8e126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:26 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e93e59c6-e560-4b6e-97a1-4b9b31e61c37 tempest-VolumesGetTest-2043637563 None] Created volume successfully.
Jul 09 09:05:27 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39" returned: 0 in 0.711s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:05:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6ab5e0-50d6-431f-8892-24d403c79b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5239f3fc-2a6b-4014-8e4c-fb1644c4a5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:27 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Volume volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39 (e91912c1-f95d-4ab1-ad41-b6826bc49c39): created successfully
Jul 09 09:05:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5239f3fc-2a6b-4014-8e4c-fb1644c4a5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Flow 'volume_create_manager' (3a852c13-e213-4107-b97a-ec71c23e94c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:27 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-bd42f6a1-69f1-4419-992b-8e580bb6340b tempest-SnapshotsActionsTest-497415373 None] Created volume successfully.
Jul 09 09:05:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] Creating offline snapshot b2770cbb-3f1f-4921-bc77-5f7d29b9d597 of volume e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:05:27 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d8f740-8b51-4d32-a90b-0abbe044fd14]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:27 devstack sudo[92945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39
Jul 09 09:05:27 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:28 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:05:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Flow 'volume_create_manager' (5b0c027d-4831-459a-819c-407aee64735d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0f5986-8ba6-41a6-aec0-9fe1eabcfd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0f5986-8ba6-41a6-aec0-9fe1eabcfd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-228456135',display_name='tempest-VolumesGetTest-Volume-1256306827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cacf11-f0a7-4f32-9fbe-f34222682f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9769fd147714e148c82ef4515e0816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:28Z,use_quota=True,user_id='507e76fa738d467a93fae7bf8d44845e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28f44e3-48be-4b8d-9933-c30ea24cbf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f28f44e3-48be-4b8d-9933-c30ea24cbf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476d65c6-c5b6-496e-94e1-9087c1c76b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476d65c6-c5b6-496e-94e1-9087c1c76b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0cacf11-f0a7-4f32-9fbe-f34222682f07', 'volume_name': 'volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c95eaf-828d-42ea-9df1-a98da91a74d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c95eaf-828d-42ea-9df1-a98da91a74d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ad274e-a1ac-4e04-8f8a-2ce5d132797a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:28 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Volume f0cacf11-f0a7-4f32-9fbe-f34222682f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07', 'volume_size': 1}
Jul 09 09:05:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:28 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39" returned: 0 in 0.921s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:28 devstack sudo[92959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 1G
Jul 09 09:05:28 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:29 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 1G" returned: 0 in 1.118s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:29 devstack sudo[93048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597
Jul 09 09:05:29 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:30 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597" returned: 0 in 0.789s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:30 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 is being set with open permissions: ugo+rw
Jul 09 09:05:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:30 devstack sudo[93056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597
Jul 09 09:05:30 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:31 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597" returned: 0 in 0.729s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:31 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=129,cinder:INSERT=37,cinder:UPDATE=138,cinder:DELETE=11 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:05:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:31 devstack sudo[93383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.info
Jul 09 09:05:31 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:32 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.info" returned: 0 in 0.750s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:32 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.info is being set with open permissions: ugo+rw
Jul 09 09:05:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:32 devstack sudo[93396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.info
Jul 09 09:05:32 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:32 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.info" returned: 0 in 0.896s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.330s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.472s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-228456135',display_name='tempest-VolumesGetTest-Volume-1256306827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cacf11-f0a7-4f32-9fbe-f34222682f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9769fd147714e148c82ef4515e0816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:28Z,use_quota=True,user_id='507e76fa738d467a93fae7bf8d44845e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:05:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Creating volume f0cacf11-f0a7-4f32-9fbe-f34222682f07 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:05:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:05:33 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:05:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:33 devstack sudo[93407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07 1073741824
Jul 09 09:05:33 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:33 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e39a394c-d2c1-4658-8150-bc8ee35e690f tempest-SnapshotsActionsTest-497415373 None] Create snapshot completed successfully
Jul 09 09:05:34 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07 1073741824" returned: 0 in 1.285s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:34 devstack sudo[93413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07
Jul 09 09:05:34 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:35 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07" returned: 0 in 1.036s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] <== create_volume: return (2417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:05:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.420s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ad274e-a1ac-4e04-8f8a-2ce5d132797a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbed9268-ca71-4f2d-abf1-16c0e76ae6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:35 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Volume volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07 (f0cacf11-f0a7-4f32-9fbe-f34222682f07): created successfully
Jul 09 09:05:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbed9268-ca71-4f2d-abf1-16c0e76ae6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Flow 'volume_create_manager' (5b0c027d-4831-459a-819c-407aee64735d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:35 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-07b19456-7f8d-467d-94b1-e06f979bc559 tempest-VolumesGetTest-2043637563 None] Created volume successfully.
Jul 09 09:05:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] Creating offline snapshot da71b821-8c70-4dd8-b401-1a0a5e2d0e1c of volume e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:05:35 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbed5c20-78a4-4170-84bf-27c8c4f44ec8]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:35 devstack sudo[93416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597
Jul 09 09:05:35 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-f0cacf11-f0a7-4f32-9fbe-f34222682f07-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Lock "cinder-f0cacf11-f0a7-4f32-9fbe-f34222682f07-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-quobyte-f0cacf11-f0a7-4f32-9fbe-f34222682f07" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-f0cacf11-f0a7-4f32-9fbe-f34222682f07" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:36 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4288a210-ce24-4db0-a4a2-561552e59916]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:36 devstack sudo[93418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07
Jul 09 09:05:36 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:36 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597" returned: 0 in 1.292s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:05:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:36 devstack sudo[93423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c 1G
Jul 09 09:05:37 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:37 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07" returned: 0 in 1.322s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:38 devstack sudo[93432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07
Jul 09 09:05:38 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:38 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c 1G" returned: 0 in 1.213s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:38 devstack sudo[93434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c
Jul 09 09:05:38 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:38 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f0cacf11-f0a7-4f32-9fbe-f34222682f07" returned: 0 in 0.783s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-f0cacf11-f0a7-4f32-9fbe-f34222682f07" released by "delete_volume" :: held 2.190s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:38 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Created reservations ['79392be9-1d86-487e-9f38-80f99e987956', '396756ba-80d3-42ba-8319-466d6f87d076', 'ce407517-a67f-4613-bcc3-fd9f2e5a5701', '86cbf6b8-5c2d-4385-984b-187ee736548a'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:05:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:38 devstack sudo[93441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:05:39 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:39 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c" returned: 0 in 0.936s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:39 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c is being set with open permissions: ugo+rw
Jul 09 09:05:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:39 devstack sudo[93443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c
Jul 09 09:05:39 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:39 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.856s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:39 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:05:39 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Deleted volume successfully.
Jul 09 09:05:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2a15f19a-7ae0-4552-aa15-e03e42519a6b tempest-VolumesGetTest-2043637563 None] Lock "cinder-f0cacf11-f0a7-4f32-9fbe-f34222682f07-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-27ff9885-711d-4c78-ad24-02246ef3b306-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Lock "cinder-27ff9885-711d-4c78-ad24-02246ef3b306-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Acquiring lock "cinder-quobyte-27ff9885-711d-4c78-ad24-02246ef3b306" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-27ff9885-711d-4c78-ad24-02246ef3b306" acquired by "delete_volume" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:40 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53c5666-a918-457b-9f0b-a2ee26275634]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:40 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c" returned: 0 in 1.230s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.808s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:40 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2af8752f-a5f2-47df-9005-095c9e4f18e6 tempest-SnapshotsActionsTest-497415373 None] Create snapshot completed successfully
Jul 09 09:05:40 devstack sudo[93447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306
Jul 09 09:05:40 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Acquiring lock "cinder-da71b821-8c70-4dd8-b401-1a0a5e2d0e1c-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-da71b821-8c70-4dd8-b401-1a0a5e2d0e1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Acquiring lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Acquiring lock "cinder-quobyte-da71b821-8c70-4dd8-b401-1a0a5e2d0e1c" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-da71b821-8c70-4dd8-b401-1a0a5e2d0e1c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Deleting offline snapshot da71b821-8c70-4dd8-b401-1a0a5e2d0e1c of volume e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:05:41 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] snapshot_file for this snap is: volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306" returned: 0 in 0.989s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd8480d-9bf6-45a8-91f8-0725e7a58d3d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Flow 'volume_create_manager' (08bd9aea-6327-4282-8aa6-aaaa31a30c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:41 devstack sudo[93451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306
Jul 09 09:05:41 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf394927-c4bc-41eb-b074-9c5195d2d33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf394927-c4bc-41eb-b074-9c5195d2d33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1306391164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15247ba5-afb1-4723-8fa0-8e6a552cec75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0156a0de904245aa26d1621db3eea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:41Z,use_quota=True,user_id='65afbc10d5514fdd8ce3338fad519d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9fc947-2948-4393-884a-e1b2de579cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9fc947-2948-4393-884a-e1b2de579cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a668bea-c758-411e-ace3-d30c97ca9e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a668bea-c758-411e-ace3-d30c97ca9e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15247ba5-afb1-4723-8fa0-8e6a552cec75', 'volume_name': 'volume-15247ba5-afb1-4723-8fa0-8e6a552cec75', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:41 devstack sudo[93452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66269e7-8534-49a1-bd64-fcbf82669d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:41 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66269e7-8534-49a1-bd64-fcbf82669d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a735a00-39db-4da9-8697-5d1d4b82f866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:41 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Volume 15247ba5-afb1-4723-8fa0-8e6a552cec75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15247ba5-afb1-4723-8fa0-8e6a552cec75', 'volume_size': 1}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1306391164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15247ba5-afb1-4723-8fa0-8e6a552cec75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0156a0de904245aa26d1621db3eea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:41Z,use_quota=True,user_id='65afbc10d5514fdd8ce3338fad519d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Creating volume 15247ba5-afb1-4723-8fa0-8e6a552cec75 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:05:41 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:05:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:41 devstack sudo[93455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75 1073741824
Jul 09 09:05:41 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:42 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306" returned: 1 in 0.831s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:05:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:42 devstack sudo[93462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306
Jul 09 09:05:42 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:42 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c" returned: 0 in 1.135s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:05:42 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75 1073741824" returned: 0 in 0.943s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:42 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e3d7a6-25a2-4460-af58-311d20d4b4b9]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:42 devstack sudo[93471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75
Jul 09 09:05:42 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:42 devstack sudo[93470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597
Jul 09 09:05:42 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:42 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-27ff9885-711d-4c78-ad24-02246ef3b306" returned: 0 in 0.794s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Lock "cinder-quobyte-27ff9885-711d-4c78-ad24-02246ef3b306" released by "delete_volume" :: held 2.696s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Created reservations ['f5977746-4435-4c52-bfa0-d25f98fc17c2', '0ef40d26-2049-4241-9188-ee23531fc0e2', 'bd94a3ac-85b9-4c98-8cbb-eb8467d52c0d', '62b45477-ecbd-4103-98f3-f8fd60b5889c'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:43 devstack sudo[93475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:05:43 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:43 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75" returned: 0 in 0.836s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a735a00-39db-4da9-8697-5d1d4b82f866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15247ba5-afb1-4723-8fa0-8e6a552cec75', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:43 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0f76df-6ad0-45a6-8d38-5a28a0674486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597" returned: 0 in 0.925s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:43 devstack sudo[93482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c
Jul 09 09:05:43 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:43 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Volume volume-15247ba5-afb1-4723-8fa0-8e6a552cec75 (15247ba5-afb1-4723-8fa0-8e6a552cec75): created successfully
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0f76df-6ad0-45a6-8d38-5a28a0674486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Flow 'volume_create_manager' (08bd9aea-6327-4282-8aa6-aaaa31a30c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:43 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-10b1f9c4-01a4-4ea7-84c0-b103d0a0a88f tempest-VolumesSnapshotTestJSON-1490969048 None] Created volume successfully.
Jul 09 09:05:44 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.885s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:44 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:05:44 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Deleted volume successfully.
Jul 09 09:05:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5774c39c-15bf-4231-9b42-dbcc11da56bb tempest-VolumesGetTest-2043637563 None] Lock "cinder-27ff9885-711d-4c78-ad24-02246ef3b306-delete_volume" released by "delete_volume" :: held 3.859s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:44 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c" returned: 0 in 0.900s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:44 devstack sudo[93488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c
Jul 09 09:05:44 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] Creating offline snapshot 7a9cefd1-c71b-4146-a85b-93b5c2ca842d of volume 15247ba5-afb1-4723-8fa0-8e6a552cec75 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:05:45 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaedf70-ea22-4b57-927d-7c9f5e4391c9]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:45 devstack sudo[93511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75
Jul 09 09:05:45 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:45 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.da71b821-8c70-4dd8-b401-1a0a5e2d0e1c" returned: 0 in 1.065s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-da71b821-8c70-4dd8-b401-1a0a5e2d0e1c" released by "_delete_snapshot" :: held 4.201s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" released by "delete_snapshot" :: held 4.251s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:45 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Created reservations ['4558423f-ef54-4de5-b138-f8d48eaedcaa', '4cabde12-8b24-40df-883f-da4b61fee99b', '8c19e155-b57c-4bba-8fe1-96ae0d83468a', '7772c61e-5394-41d6-a157-ce138e0be1f9'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:05:45 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Delete snapshot completed successfully.
Jul 09 09:05:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-deaa343c-8e82-49b9-9c33-9447a2196bc1 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-da71b821-8c70-4dd8-b401-1a0a5e2d0e1c-delete_snapshot" released by "delete_snapshot" :: held 4.466s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:46 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75" returned: 0 in 1.089s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:46 devstack sudo[93517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d 1G
Jul 09 09:05:46 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:47 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d 1G" returned: 0 in 0.923s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15247ba5-afb1-4723-8fa0-8e6a552cec75 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:47 devstack sudo[93523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15247ba5-afb1-4723-8fa0-8e6a552cec75 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d
Jul 09 09:05:47 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Flow 'volume_create_manager' (31a37cde-cdef-430e-9961-5f117f11bb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf412e6-ca4f-4c0f-b3b8-7c64abe588df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf412e6-ca4f-4c0f-b3b8-7c64abe588df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-196076890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68f5885-060d-465e-867f-b36b2e62d71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a36738134bf419fa19dd6456c67ac98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:47Z,use_quota=True,user_id='5f5a8b1215b341c4b77893d6c8de7541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1e3fa8-f601-4e02-be2f-e3cc9c6f07ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1e3fa8-f601-4e02-be2f-e3cc9c6f07ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4adc72-24b8-4c7b-a2f7-3819618c173e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4adc72-24b8-4c7b-a2f7-3819618c173e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f68f5885-060d-465e-867f-b36b2e62d71a', 'volume_name': 'volume-f68f5885-060d-465e-867f-b36b2e62d71a', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f0867b-7b87-40fd-83c0-08b82f72429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f0867b-7b87-40fd-83c0-08b82f72429a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd59699b-0e58-4522-9f5f-3fda5abc5821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:47 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Volume f68f5885-060d-465e-867f-b36b2e62d71a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f68f5885-060d-465e-867f-b36b2e62d71a', 'volume_size': 1}
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:47 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15247ba5-afb1-4723-8fa0-8e6a552cec75 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d" returned: 0 in 0.696s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:47 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d is being set with open permissions: ugo+rw
Jul 09 09:05:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:47 devstack sudo[93529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d
Jul 09 09:05:47 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:48 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d" returned: 0 in 0.653s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:48 devstack sudo[93532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.info
Jul 09 09:05:48 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:49 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.info" returned: 0 in 0.630s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:49 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.info is being set with open permissions: ugo+rw
Jul 09 09:05:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:49 devstack sudo[93560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.info
Jul 09 09:05:49 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:49 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.info" returned: 0 in 0.653s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.742s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.848s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] Creating offline snapshot e04e700f-7ed2-488d-ab01-9b695d045404 of volume e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:05:49 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a63632f-6d87-4f42-b242-2b59578cd8bb]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:49 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-dab5b08c-5f92-42ac-b0e2-224edc70967d tempest-VolumesSnapshotTestJSON-1490969048 None] Create snapshot completed successfully
Jul 09 09:05:49 devstack sudo[93563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597
Jul 09 09:05:49 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-7a9cefd1-c71b-4146-a85b-93b5c2ca842d-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-7a9cefd1-c71b-4146-a85b-93b5c2ca842d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-15247ba5-afb1-4723-8fa0-8e6a552cec75" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-15247ba5-afb1-4723-8fa0-8e6a552cec75" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-7a9cefd1-c71b-4146-a85b-93b5c2ca842d" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-7a9cefd1-c71b-4146-a85b-93b5c2ca842d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Deleting offline snapshot 7a9cefd1-c71b-4146-a85b-93b5c2ca842d of volume 15247ba5-afb1-4723-8fa0-8e6a552cec75 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:05:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] snapshot_file for this snap is: volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:05:50 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e643f8c-9c36-4c93-9d71-64f61b8335d5]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:50 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597" returned: 0 in 0.780s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:05:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:50 devstack sudo[93568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d
Jul 09 09:05:50 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:50 devstack sudo[93569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404 1G
Jul 09 09:05:50 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:51 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d" returned: 0 in 0.783s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15247ba5-afb1-4723-8fa0-8e6a552cec75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:05:51 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b6d1ac-a9c1-458a-a9e7-5fae3b2c0d95]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:51 devstack sudo[93580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75
Jul 09 09:05:51 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:51 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404 1G" returned: 0 in 0.887s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:51 devstack sudo[93583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404
Jul 09 09:05:51 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:52 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75" returned: 0 in 0.879s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:52 devstack sudo[93592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d
Jul 09 09:05:52 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:52 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404" returned: 0 in 0.839s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:52 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404 is being set with open permissions: ugo+rw
Jul 09 09:05:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:52 devstack sudo[93597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404
Jul 09 09:05:52 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:52 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d" returned: 0 in 0.802s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:53 devstack sudo[93614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d
Jul 09 09:05:53 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:53 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404" returned: 0 in 0.752s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.372s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.906s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-196076890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68f5885-060d-465e-867f-b36b2e62d71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a36738134bf419fa19dd6456c67ac98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:47Z,use_quota=True,user_id='5f5a8b1215b341c4b77893d6c8de7541',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Creating volume f68f5885-060d-465e-867f-b36b2e62d71a {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:05:53 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f68f5885-060d-465e-867f-b36b2e62d71a 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:53 devstack sudo[93616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f68f5885-060d-465e-867f-b36b2e62d71a 1073741824
Jul 09 09:05:53 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:53 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-36e9b8b7-0616-4f05-90d1-7aca60b08a12 tempest-SnapshotsActionsTest-497415373 None] Create snapshot completed successfully
Jul 09 09:05:53 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75.7a9cefd1-c71b-4146-a85b-93b5c2ca842d" returned: 0 in 0.712s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-7a9cefd1-c71b-4146-a85b-93b5c2ca842d" released by "_delete_snapshot" :: held 3.282s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-15247ba5-afb1-4723-8fa0-8e6a552cec75" released by "delete_snapshot" :: held 3.304s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Created reservations ['ef64c761-4160-4367-9535-5a6115733c8f', 'ca01db1a-a582-4c48-a9a2-f352dd8dde30', '7c8544c9-9708-43b5-ac07-63c630ec16bd', 'bbc9f1a2-3151-43d4-9cad-12c2c3de3baf'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:05:53 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Delete snapshot completed successfully.
Jul 09 09:05:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fb0ef14c-11c8-4d06-a08c-a8b5ac0b954a tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-7a9cefd1-c71b-4146-a85b-93b5c2ca842d-delete_snapshot" released by "delete_snapshot" :: held 3.486s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:54 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f68f5885-060d-465e-867f-b36b2e62d71a 1073741824" returned: 0 in 0.996s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:54 devstack sudo[93623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:05:54 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f68f5885-060d-465e-867f-b36b2e62d71a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:54 devstack sudo[93625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f68f5885-060d-465e-867f-b36b2e62d71a
Jul 09 09:05:54 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Acquiring lock "cinder-e04e700f-7ed2-488d-ab01-9b695d045404-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-e04e700f-7ed2-488d-ab01-9b695d045404-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Acquiring lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Acquiring lock "cinder-quobyte-e04e700f-7ed2-488d-ab01-9b695d045404" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-e04e700f-7ed2-488d-ab01-9b695d045404" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Deleting offline snapshot e04e700f-7ed2-488d-ab01-9b695d045404 of volume e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] snapshot_file for this snap is: volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[38289d20-a163-4a4d-bd43-f366e0424fea]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:54 devstack sudo[93627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404
Jul 09 09:05:54 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:54 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.778s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:05:54 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f68f5885-060d-465e-867f-b36b2e62d71a" returned: 0 in 0.741s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd59699b-0e58-4522-9f5f-3fda5abc5821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68f5885-060d-465e-867f-b36b2e62d71a', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38acdc9b-1756-4a66-aa31-b556e2c1e0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:54 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Volume volume-f68f5885-060d-465e-867f-b36b2e62d71a (f68f5885-060d-465e-867f-b36b2e62d71a): created successfully
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38acdc9b-1756-4a66-aa31-b556e2c1e0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Flow 'volume_create_manager' (31a37cde-cdef-430e-9961-5f117f11bb9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:55 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-429094b8-a0c0-4423-96c4-4d43a95cbd4d tempest-VolumesNegativeTest-1293206634 None] Created volume successfully.
Jul 09 09:05:55 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404" returned: 0 in 0.993s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3177eb8-24dd-420a-9435-ddd826c3a3be]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Flow 'volume_create_manager' (d434cf8c-b799-4d61-9745-245b09b9aae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da5ca3a1-2025-45d0-b42c-aa903d015b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da5ca3a1-2025-45d0-b42c-aa903d015b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1690070967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cee02b2-2bea-4a85-8931-28403393380f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0156a0de904245aa26d1621db3eea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:55Z,use_quota=True,user_id='65afbc10d5514fdd8ce3338fad519d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fc74a1-4ca6-47ce-8010-a810393886ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fc74a1-4ca6-47ce-8010-a810393886ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df32d165-2851-4d51-8fb4-86572d4bd58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df32d165-2851-4d51-8fb4-86572d4bd58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cee02b2-2bea-4a85-8931-28403393380f', 'volume_name': 'volume-2cee02b2-2bea-4a85-8931-28403393380f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd7ee1c-71c1-412a-ba68-22fb5e555abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd7ee1c-71c1-412a-ba68-22fb5e555abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3528a0-0ba9-4bd2-b3e9-80daf8bfe863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:55 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Volume 2cee02b2-2bea-4a85-8931-28403393380f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cee02b2-2bea-4a85-8931-28403393380f', 'volume_size': 1}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1690070967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cee02b2-2bea-4a85-8931-28403393380f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0156a0de904245aa26d1621db3eea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:05:55Z,use_quota=True,user_id='65afbc10d5514fdd8ce3338fad519d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Creating volume 2cee02b2-2bea-4a85-8931-28403393380f {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:05:55 devstack sudo[93637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:05:55 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:05:55 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:55 devstack sudo[93640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f 1073741824
Jul 09 09:05:55 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:56 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597" returned: 0 in 0.858s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:05:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:56 devstack sudo[93653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404
Jul 09 09:05:56 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:56 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f 1073741824" returned: 0 in 1.031s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:56 devstack sudo[93655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f
Jul 09 09:05:56 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:56 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-2411f6ef-f1e5-416b-83f0-84f9fda6a4b0 req-a55c7ca8-2150-4139-aa8b-5e4a4759e8f0 tempest-ServerActionsTestOtherA-1511266625 None] Terminate volume connection completed successfully.
Jul 09 09:05:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-2411f6ef-f1e5-416b-83f0-84f9fda6a4b0 req-a55c7ca8-2150-4139-aa8b-5e4a4759e8f0 tempest-ServerActionsTestOtherA-1511266625 None] Deleting attachment 4b076df2-514a-4e75-abc2-fec30d7b78a6. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:05:57 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404" returned: 0 in 0.997s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:57 devstack sudo[93665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404
Jul 09 09:05:57 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:57 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f" returned: 0 in 0.923s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:05:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:05:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3528a0-0ba9-4bd2-b3e9-80daf8bfe863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cee02b2-2bea-4a85-8931-28403393380f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09db6b8a-9749-4745-80e0-4540ab19d8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:05:57 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=143,cinder:SELECT=136,cinder:INSERT=43,cinder:DELETE=10 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:05:57 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Volume volume-2cee02b2-2bea-4a85-8931-28403393380f (2cee02b2-2bea-4a85-8931-28403393380f): created successfully
Jul 09 09:05:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09db6b8a-9749-4745-80e0-4540ab19d8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:05:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Flow 'volume_create_manager' (d434cf8c-b799-4d61-9745-245b09b9aae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:05:57 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-c271605e-9d43-4107-ad94-a5112cf33761 tempest-VolumesSnapshotTestJSON-1490969048 None] Created volume successfully.
Jul 09 09:05:58 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.e04e700f-7ed2-488d-ab01-9b695d045404" returned: 0 in 0.777s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-e04e700f-7ed2-488d-ab01-9b695d045404" released by "_delete_snapshot" :: held 3.723s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" released by "delete_snapshot" :: held 3.751s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:58 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Created reservations ['80f2ebc3-3bda-47e3-8b13-131dde2cb2a8', 'b08e3cf2-7526-45d9-b80f-45c495370b65', '96b090e4-291b-4348-988b-740b113b52d2', '93f91c4e-a2b0-493b-a531-2a9e0979fc73'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:05:58 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Delete snapshot completed successfully.
Jul 09 09:05:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3486b13a-931b-4d8a-81fa-4a5da01c2b17 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-e04e700f-7ed2-488d-ab01-9b695d045404-delete_snapshot" released by "delete_snapshot" :: held 3.910s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:05:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:05:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] Creating offline snapshot c74e1e1d-89d8-440f-90a7-d8ba87ac60af of volume 2cee02b2-2bea-4a85-8931-28403393380f {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:05:58 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a061dfb-061c-49f8-996d-ec60ceb9b2f2]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:05:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:58 devstack sudo[93670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f
Jul 09 09:05:58 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:05:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:05:59 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root
Jul 09 09:05:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f" returned: 0 in 0.836s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:05:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:05:59 devstack sudo[93676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af 1G
Jul 09 09:05:59 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:00 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af 1G" returned: 0 in 0.807s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cee02b2-2bea-4a85-8931-28403393380f -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:00 devstack sudo[93686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cee02b2-2bea-4a85-8931-28403393380f -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af
Jul 09 09:06:00 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:01 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cee02b2-2bea-4a85-8931-28403393380f -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af" returned: 0 in 0.893s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:01 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af is being set with open permissions: ugo+rw
Jul 09 09:06:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:01 devstack sudo[93711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af
Jul 09 09:06:01 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:02 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af" returned: 0 in 0.834s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:02 devstack sudo[93716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.info
Jul 09 09:06:02 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:03 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.info" returned: 0 in 0.912s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:03 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.info is being set with open permissions: ugo+rw
Jul 09 09:06:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:03 devstack sudo[93722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.info
Jul 09 09:06:03 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:03 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.info" returned: 0 in 0.703s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.093s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.828s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:03 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] Creating offline snapshot 40b84c76-ca97-4ef3-82ab-68a211d1f91b of volume e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:06:03 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b5db442d-b922-437e-b9a9-6f8a02172071 tempest-VolumesSnapshotTestJSON-1490969048 None] Create snapshot completed successfully
Jul 09 09:06:03 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15e294a-3528-47ff-b426-7c7ea33b20c1]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:03 devstack sudo[93740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597
Jul 09 09:06:03 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:04 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597" returned: 0 in 0.820s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:06:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:04 devstack sudo[93745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b 1G
Jul 09 09:06:04 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:05 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:06:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Flow 'volume_create_manager' (fd0555fb-bba4-4044-ae50-dc6dbe7e6c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:06:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb6c078-5588-42fb-9c61-e81e9c44ce21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb6c078-5588-42fb-9c61-e81e9c44ce21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1605377684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1acdb23c-e874-48ec-98f4-504aa0f41910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0156a0de904245aa26d1621db3eea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:06:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c74e1e1d-89d8-440f-90a7-d8ba87ac60af,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:06:05Z,use_quota=True,user_id='65afbc10d5514fdd8ce3338fad519d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05554ec7-a0b5-44ea-b203-c3708a17b9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05554ec7-a0b5-44ea-b203-c3708a17b9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a585eae-c245-4eb2-82c2-ddd84056d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a585eae-c245-4eb2-82c2-ddd84056d416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1acdb23c-e874-48ec-98f4-504aa0f41910', 'volume_name': 'volume-1acdb23c-e874-48ec-98f4-504aa0f41910', 'volume_size': 2, 'snapshot_id': 'c74e1e1d-89d8-440f-90a7-d8ba87ac60af'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:05 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089ed471-a9a5-40b8-8ef7-2ff932051318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089ed471-a9a5-40b8-8ef7-2ff932051318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f744ea70-b94c-48a8-9976-69d96c6ee8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:05 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Volume 1acdb23c-e874-48ec-98f4-504aa0f41910: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1acdb23c-e874-48ec-98f4-504aa0f41910', 'volume_size': 2, 'snapshot_id': 'c74e1e1d-89d8-440f-90a7-d8ba87ac60af'}
Jul 09 09:06:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b 1G" returned: 0 in 0.985s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:05 devstack sudo[93750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b
Jul 09 09:06:05 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:06 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b" returned: 0 in 0.733s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:06 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b is being set with open permissions: ugo+rw
Jul 09 09:06:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:06 devstack sudo[93755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b
Jul 09 09:06:06 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:07 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b" returned: 0 in 0.708s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.455s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.528s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-c74e1e1d-89d8-440f-90a7-d8ba87ac60af-1acdb23c-e874-48ec-98f4-504aa0f41910" by "_create_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-c74e1e1d-89d8-440f-90a7-d8ba87ac60af-1acdb23c-e874-48ec-98f4-504aa0f41910" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Creating volume 1acdb23c-e874-48ec-98f4-504aa0f41910 from snapshot c74e1e1d-89d8-440f-90a7-d8ba87ac60af {{(pid=87009) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-1acdb23c-e874-48ec-98f4-504aa0f41910" by "_copy_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-1acdb23c-e874-48ec-98f4-504aa0f41910" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] snapshot: c74e1e1d-89d8-440f-90a7-d8ba87ac60af, volume: 1acdb23c-e874-48ec-98f4-504aa0f41910,  {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 09:06:07 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-0716f8b0-2152-48c8-b8ae-0169e79d0dcf tempest-SnapshotsActionsTest-497415373 None] Create snapshot completed successfully
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a314b6bf-96c0-4d42-90b5-3cd395ee8567]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Acquiring lock "cinder-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Lock "cinder-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:07 devstack sudo[93785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af
Jul 09 09:06:07 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Acquiring lock "cinder-quobyte-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Lock "cinder-quobyte-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb" acquired by "delete_volume" :: waited 0.038s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c4599e-bf2d-49c4-9666-79b7f5392c40]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:07 devstack sudo[93794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb
Jul 09 09:06:07 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Acquiring lock "cinder-40b84c76-ca97-4ef3-82ab-68a211d1f91b-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-40b84c76-ca97-4ef3-82ab-68a211d1f91b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Acquiring lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:08 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af" returned: 0 in 1.070s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cee02b2-2bea-4a85-8931-28403393380f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] will copy from snapshot at /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Creating direct copy from snapshot {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Acquiring lock "cinder-quobyte-40b84c76-ca97-4ef3-82ab-68a211d1f91b" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[929ba771-1791-47c9-905c-d89165a36337]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-40b84c76-ca97-4ef3-82ab-68a211d1f91b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Deleting offline snapshot 40b84c76-ca97-4ef3-82ab-68a211d1f91b of volume e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] snapshot_file for this snap is: volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa15305-064d-4edc-899d-66c2f5d953a8]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:08 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb" returned: 0 in 0.936s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:08 devstack sudo[93815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f
Jul 09 09:06:08 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:08 devstack sudo[93818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb
Jul 09 09:06:08 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:08 devstack sudo[93817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b
Jul 09 09:06:08 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:09 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b" returned: 0 in 0.888s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:06:09 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb" returned: 0 in 0.858s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Lock "cinder-quobyte-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb" released by "delete_volume" :: held 1.858s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[941bd812-99aa-486a-a8d5-dc416f16464d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:09 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f" returned: 0 in 1.039s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG cinder.utils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Path /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910 not found in is_blk_device check {{(pid=87009) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:09 devstack sudo[93850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910
Jul 09 09:06:09 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Created reservations ['fa82ee1e-a9e1-4b86-ac26-c0a41ab1b41d', '7b0bde9c-396e-4ca1-90e4-c97b75db0caa', 'a50ef5d9-5113-4c77-929c-2619c23b1e38', '1c90ac63-b2bd-41ae-9686-a76711bfa602'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:06:09 devstack sudo[93849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597
Jul 09 09:06:09 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:09 devstack sudo[93853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:06:09 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:10 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597" returned: 0 in 1.274s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:06:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:10 devstack sudo[93866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b
Jul 09 09:06:10 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:11 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.247s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:11 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:06:11 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Deleted volume successfully.
Jul 09 09:06:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0a50bc92-1b38-491e-adca-295a62cda7fa tempest-ServerActionsTestOtherA-1511266625 None] Lock "cinder-f1e259c1-9c46-40f5-aa99-0f4ad90fbfbb-delete_volume" released by "delete_volume" :: held 3.612s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:13 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b" returned: 0 in 3.190s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:14 devstack sudo[93899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b
Jul 09 09:06:14 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:16 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.40b84c76-ca97-4ef3-82ab-68a211d1f91b" returned: 0 in 2.226s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-40b84c76-ca97-4ef3-82ab-68a211d1f91b" released by "_delete_snapshot" :: held 7.806s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" released by "delete_snapshot" :: held 7.884s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:16 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Created reservations ['13a07617-b9da-47e5-be9c-27838a930483', '09955f85-81e3-43df-8d6e-41556d30d19b', 'd68ddb6e-a944-47dc-9d02-33c095021f94', 'b96c8907-7392-4948-b1c7-10b421434d5f'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:06:16 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Delete snapshot completed successfully.
Jul 09 09:06:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e881f0bd-f795-49e4-81ff-e82784bb75c7 tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-40b84c76-ca97-4ef3-82ab-68a211d1f91b-delete_snapshot" released by "delete_snapshot" :: held 8.389s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:17 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910" returned: 0 in 8.360s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:17 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65c4b9f-3827-42f6-8517-4ccaf63d357c]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:18 devstack sudo[93959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f
Jul 09 09:06:18 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:18 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f" returned: 0 in 0.996s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:18 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Image conversion details: src /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f, size 1024.00 MB, duration 8.36 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910 {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:06:18 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Converted 1024.00 MB image at 122.46 MB/s
Jul 09 09:06:18 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910 is being set with open permissions: ugo+rw
Jul 09 09:06:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:18 devstack sudo[93968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910
Jul 09 09:06:18 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:19 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910" returned: 0 in 0.622s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-1acdb23c-e874-48ec-98f4-504aa0f41910" released by "_copy_volume_from_snapshot" :: held 12.259s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-c74e1e1d-89d8-440f-90a7-d8ba87ac60af-1acdb23c-e874-48ec-98f4-504aa0f41910" released by "_create_volume_from_snapshot" :: held 12.312s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.359s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.647s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] Creating offline snapshot 0db857ba-74b0-41d7-8a5b-42d2e1255009 of volume e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:06:19 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[de34255a-d78f-41fc-9b3f-7ac9c81d2e0d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f744ea70-b94c-48a8-9976-69d96c6ee8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1acdb23c-e874-48ec-98f4-504aa0f41910', 'volume_size': 2, 'snapshot_id': 'c74e1e1d-89d8-440f-90a7-d8ba87ac60af'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5bec94-310d-4720-9054-2e5e4ef219bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:19 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Volume volume-1acdb23c-e874-48ec-98f4-504aa0f41910 (1acdb23c-e874-48ec-98f4-504aa0f41910): created successfully
Jul 09 09:06:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5bec94-310d-4720-9054-2e5e4ef219bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Flow 'volume_create_manager' (fd0555fb-bba4-4044-ae50-dc6dbe7e6c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:06:19 devstack sudo[93971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597
Jul 09 09:06:19 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:19 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b0b5a692-407a-4543-9cd1-cc2dbc3993f3 tempest-VolumesSnapshotTestJSON-1490969048 None] Created volume successfully.
Jul 09 09:06:20 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597" returned: 0 in 0.827s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:06:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:20 devstack sudo[93978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009 1G
Jul 09 09:06:20 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-1acdb23c-e874-48ec-98f4-504aa0f41910-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-1acdb23c-e874-48ec-98f4-504aa0f41910-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-1acdb23c-e874-48ec-98f4-504aa0f41910" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-1acdb23c-e874-48ec-98f4-504aa0f41910" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:21 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac94338b-60af-4c44-888b-a381b0ad56b0]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:21 devstack sudo[93980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910
Jul 09 09:06:21 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:21 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009 1G" returned: 0 in 0.892s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:21 devstack sudo[93986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009
Jul 09 09:06:21 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:21 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910" returned: 0 in 0.796s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:21 devstack sudo[93991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910
Jul 09 09:06:21 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:22 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009" returned: 0 in 0.739s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:22 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009 is being set with open permissions: ugo+rw
Jul 09 09:06:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:22 devstack sudo[93996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009
Jul 09 09:06:22 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:22 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1acdb23c-e874-48ec-98f4-504aa0f41910" returned: 0 in 0.710s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-1acdb23c-e874-48ec-98f4-504aa0f41910" released by "delete_volume" :: held 1.580s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:22 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Created reservations ['ff8421e5-ea27-43e9-88d7-54ccca4ba6cc', '98fc2263-cafe-47ae-8344-2f8dedc37003', '40a0fe45-9c43-4374-b48c-26aaf20c15ad', 'bf360607-150f-4d9e-8e0e-4bcc82471a2c'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:06:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:22 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:06:22 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:06:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:22 devstack sudo[94001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:06:22 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:22 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009" returned: 0 in 0.783s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.355s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:22 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-bfdd04bf-062f-4f0d-be74-21b028e0eaec tempest-SnapshotsActionsTest-497415373 None] Create snapshot completed successfully
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-c74e1e1d-89d8-440f-90a7-d8ba87ac60af-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-c74e1e1d-89d8-440f-90a7-d8ba87ac60af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-2cee02b2-2bea-4a85-8931-28403393380f" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-2cee02b2-2bea-4a85-8931-28403393380f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-c74e1e1d-89d8-440f-90a7-d8ba87ac60af" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-c74e1e1d-89d8-440f-90a7-d8ba87ac60af" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Deleting offline snapshot c74e1e1d-89d8-440f-90a7-d8ba87ac60af of volume 2cee02b2-2bea-4a85-8931-28403393380f {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] snapshot_file for this snap is: volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13031aa-58f2-493e-b342-c6093f1c1b4d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Acquiring lock "cinder-0db857ba-74b0-41d7-8a5b-42d2e1255009-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-0db857ba-74b0-41d7-8a5b-42d2e1255009-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:23 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Acquiring lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.747s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:06:23 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Deleted volume successfully.
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Acquiring lock "cinder-quobyte-0db857ba-74b0-41d7-8a5b-42d2e1255009" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-0db857ba-74b0-41d7-8a5b-42d2e1255009" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Deleting offline snapshot 0db857ba-74b0-41d7-8a5b-42d2e1255009 of volume e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:06:23 devstack sudo[94005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af
Jul 09 09:06:23 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] snapshot_file for this snap is: volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1aadbfbe-f171-4e81-abaa-75b38c97f74a tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-1acdb23c-e874-48ec-98f4-504aa0f41910-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be0180b-a6f7-498b-afb7-fab1ce2fb784]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:23 devstack sudo[94007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009
Jul 09 09:06:23 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:24 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af" returned: 0 in 1.100s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cee02b2-2bea-4a85-8931-28403393380f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:06:24 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[341021f5-0487-44cc-8572-c809d6847dba]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:24 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009" returned: 0 in 1.022s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:06:24 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd03abc-d4fd-4998-9bc4-fca2580f27ab]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:24 devstack sudo[94017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f
Jul 09 09:06:24 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:24 devstack sudo[94018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597
Jul 09 09:06:24 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:25 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f" returned: 0 in 0.900s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:25 devstack sudo[94028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af
Jul 09 09:06:25 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:25 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597" returned: 0 in 0.981s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:06:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:25 devstack sudo[94030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009
Jul 09 09:06:25 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:26 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af" returned: 0 in 0.907s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:26 devstack sudo[94041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af
Jul 09 09:06:26 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:26 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009" returned: 0 in 1.023s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:26 devstack sudo[94044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009
Jul 09 09:06:26 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:27 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f.c74e1e1d-89d8-440f-90a7-d8ba87ac60af" returned: 0 in 0.776s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-c74e1e1d-89d8-440f-90a7-d8ba87ac60af" released by "_delete_snapshot" :: held 3.870s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-2cee02b2-2bea-4a85-8931-28403393380f" released by "delete_snapshot" :: held 3.915s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Created reservations ['8c8abd0b-ba67-416f-9386-eb6b303312a7', 'e023699c-fa64-49ea-92fb-c8c4e31c984b', 'e5a71191-2ce5-4e05-bf40-fe3901859a42', '86f882fa-7f41-4af1-bb55-3255c4ab25a9'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:06:27 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Delete snapshot completed successfully.
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bc9d3ba8-2dfb-4791-ac48-2ec3f15ba12c tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-c74e1e1d-89d8-440f-90a7-d8ba87ac60af-delete_snapshot" released by "delete_snapshot" :: held 4.129s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:27 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.0db857ba-74b0-41d7-8a5b-42d2e1255009" returned: 0 in 0.830s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-0db857ba-74b0-41d7-8a5b-42d2e1255009" released by "_delete_snapshot" :: held 3.969s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" released by "delete_snapshot" :: held 4.013s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Created reservations ['47473e89-9eee-4258-b9b3-6ed719341322', 'c908884f-f224-49c0-889f-223e150f13cd', '8de11081-689b-4197-85bb-2d64387c8cd1', '6f325a06-0175-421e-87a0-331bed2183e9'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-2cee02b2-2bea-4a85-8931-28403393380f-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-2cee02b2-2bea-4a85-8931-28403393380f-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:27 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Delete snapshot completed successfully.
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20da84e-c489-40c4-acd9-4d76e761eeef tempest-SnapshotsActionsTest-789194763 None] Lock "cinder-0db857ba-74b0-41d7-8a5b-42d2e1255009-delete_snapshot" released by "delete_snapshot" :: held 4.359s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-2cee02b2-2bea-4a85-8931-28403393380f" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-2cee02b2-2bea-4a85-8931-28403393380f" acquired by "delete_volume" :: waited 0.036s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3b2c11-3e80-4c01-8470-4439718efae4]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:28 devstack sudo[94048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f
Jul 09 09:06:28 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Acquiring lock "cinder-b2770cbb-3f1f-4921-bc77-5f7d29b9d597-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Lock "cinder-b2770cbb-3f1f-4921-bc77-5f7d29b9d597-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Acquiring lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Acquiring lock "cinder-quobyte-b2770cbb-3f1f-4921-bc77-5f7d29b9d597" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Lock "cinder-quobyte-b2770cbb-3f1f-4921-bc77-5f7d29b9d597" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Deleting offline snapshot b2770cbb-3f1f-4921-bc77-5f7d29b9d597 of volume e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:06:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] snapshot_file for this snap is: volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:06:28 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e0f373-bd20-4eb0-a884-d93a0320dbd6]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:28 devstack sudo[94050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597
Jul 09 09:06:28 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:28 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f" returned: 0 in 0.969s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:28 devstack sudo[94058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f
Jul 09 09:06:28 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:29 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597" returned: 0 in 1.122s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:06:29 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c279188a-4bc8-43ac-baba-7f844a4d4aa3]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:29 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2cee02b2-2bea-4a85-8931-28403393380f" returned: 0 in 0.804s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-2cee02b2-2bea-4a85-8931-28403393380f" released by "delete_volume" :: held 1.864s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:29 devstack sudo[94064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39
Jul 09 09:06:29 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:29 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Created reservations ['be8a1cb4-859d-49d2-9e8f-ce2dfa27473a', 'b0aee8ba-e467-4c16-9340-370fce22067c', 'a8e52ceb-972f-49ee-9232-879540f72a8a', 'f53385cc-2c3a-4fd1-8b15-538768367189'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:06:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:06:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:06:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:29 devstack sudo[94066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:06:29 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:30 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39" returned: 0 in 1.125s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:30 devstack sudo[94072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597
Jul 09 09:06:30 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:30 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:06:30 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Flow 'volume_create_manager' (43d6528d-4429-45b0-ba39-c18e8e89dae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:06:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae0e691-9b02-4e3a-91af-d6ef93642071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.125s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Acquiring lock "cinder-f68f5885-060d-465e-867f-b36b2e62d71a-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae0e691-9b02-4e3a-91af-d6ef93642071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1127065356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea8943c-3f91-4a16-a73c-ed678361e289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0156a0de904245aa26d1621db3eea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:06:31Z,use_quota=True,user_id='65afbc10d5514fdd8ce3338fad519d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eaa0d12-aafd-43d9-817a-ee4c88491ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eaa0d12-aafd-43d9-817a-ee4c88491ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2176ba-d12a-4756-8d8f-3a0d87393e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2176ba-d12a-4756-8d8f-3a0d87393e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea8943c-3f91-4a16-a73c-ed678361e289', 'volume_name': 'volume-bea8943c-3f91-4a16-a73c-ed678361e289', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c078b61b-1020-4123-b857-c52ecf833b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c078b61b-1020-4123-b857-c52ecf833b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f3fe29-9dbb-4c3b-8f73-a5c7f2de8a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:31 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Volume bea8943c-3f91-4a16-a73c-ed678361e289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea8943c-3f91-4a16-a73c-ed678361e289', 'volume_size': 1}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1127065356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea8943c-3f91-4a16-a73c-ed678361e289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0156a0de904245aa26d1621db3eea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:06:31Z,use_quota=True,user_id='65afbc10d5514fdd8ce3338fad519d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Creating volume bea8943c-3f91-4a16-a73c-ed678361e289 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:06:31 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:31 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Deleted volume successfully.
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Lock "cinder-f68f5885-060d-465e-867f-b36b2e62d71a-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:31 devstack sudo[94074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289 1073741824
Jul 09 09:06:31 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5325a1e1-16a1-4732-8dd0-55f2b25ae902 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-2cee02b2-2bea-4a85-8931-28403393380f-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Acquiring lock "cinder-quobyte-f68f5885-060d-465e-867f-b36b2e62d71a" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Lock "cinder-quobyte-f68f5885-060d-465e-867f-b36b2e62d71a" acquired by "delete_volume" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98179ba-ddf3-43c1-8f3c-7508f63796e6]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f68f5885-060d-465e-867f-b36b2e62d71a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:31 devstack sudo[94076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f68f5885-060d-465e-867f-b36b2e62d71a
Jul 09 09:06:31 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:31 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597" returned: 0 in 0.935s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:31 devstack sudo[94082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597
Jul 09 09:06:31 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:32 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289 1073741824" returned: 0 in 0.981s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:32 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f68f5885-060d-465e-867f-b36b2e62d71a" returned: 0 in 0.894s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:32 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=87,cinder:UPDATE=93,cinder:INSERT=26,cinder:DELETE=9 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:06:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f68f5885-060d-465e-867f-b36b2e62d71a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:32 devstack sudo[94091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f68f5885-060d-465e-867f-b36b2e62d71a
Jul 09 09:06:32 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:32 devstack sudo[94093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289
Jul 09 09:06:32 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:32 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39.b2770cbb-3f1f-4921-bc77-5f7d29b9d597" returned: 0 in 0.809s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Lock "cinder-quobyte-b2770cbb-3f1f-4921-bc77-5f7d29b9d597" released by "_delete_snapshot" :: held 4.133s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" released by "delete_snapshot" :: held 4.161s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:32 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Created reservations ['efb50ce4-48ab-4baf-9299-641778ffc500', '571ce21e-17b5-40e2-92ac-4f69d2a11cc0', '036d2afa-97b6-43c9-93ba-de3612a4a2fc', '231f59d6-bc19-4a27-b174-0c09fd5e209f'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:06:32 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Delete snapshot completed successfully.
Jul 09 09:06:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-afde975d-6264-4d74-9452-6fe1d3a9c278 tempest-SnapshotsActionsTest-497415373 None] Lock "cinder-b2770cbb-3f1f-4921-bc77-5f7d29b9d597-delete_snapshot" released by "delete_snapshot" :: held 4.378s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:32 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289" returned: 0 in 0.810s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:06:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f3fe29-9dbb-4c3b-8f73-a5c7f2de8a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea8943c-3f91-4a16-a73c-ed678361e289', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23b4c7f-78a1-441e-8d12-79381eb8517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:33 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Volume volume-bea8943c-3f91-4a16-a73c-ed678361e289 (bea8943c-3f91-4a16-a73c-ed678361e289): created successfully
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23b4c7f-78a1-441e-8d12-79381eb8517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Flow 'volume_create_manager' (43d6528d-4429-45b0-ba39-c18e8e89dae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:06:33 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f68f5885-060d-465e-867f-b36b2e62d71a" returned: 0 in 0.936s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:33 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-4f3ab901-5aee-41df-835b-05bde3e2692f tempest-VolumesSnapshotTestJSON-1490969048 None] Created volume successfully.
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Lock "cinder-quobyte-f68f5885-060d-465e-867f-b36b2e62d71a" released by "delete_volume" :: held 1.887s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Created reservations ['08c0ec23-99f5-489d-8ae5-3eaa99d3e493', 'e70682c4-6ad9-4798-81b6-bd882c0e2eca', '62bba17b-e6a2-4d01-a8a0-88a6dabbfc96', 'cd0cfa02-2891-44b6-a44c-d34fb3fd1bd8'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:33 devstack sudo[94104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:06:33 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Acquiring lock "cinder-e91912c1-f95d-4ab1-ad41-b6826bc49c39-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Lock "cinder-e91912c1-f95d-4ab1-ad41-b6826bc49c39-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:33 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.739s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:06:33 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Deleted volume successfully.
Jul 09 09:06:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Acquiring lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-06765907-8aaa-4d4a-b2ff-8828bba7c63d tempest-VolumesNegativeTest-1293206634 None] Lock "cinder-f68f5885-060d-465e-867f-b36b2e62d71a-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" acquired by "delete_volume" :: waited 0.036s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:34 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a528eeb4-c584-4fba-b25b-ab660946276a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:34 devstack sudo[94107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39
Jul 09 09:06:34 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:34 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] Creating offline snapshot efab9c9f-1df4-4d82-b031-71442c2374f6 of volume bea8943c-3f91-4a16-a73c-ed678361e289 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:06:34 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a55f03-5ca5-4257-a7c2-03677df3bb76]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:34 devstack sudo[94109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289
Jul 09 09:06:34 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:35 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39" returned: 0 in 0.972s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:35 devstack sudo[94114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39
Jul 09 09:06:35 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:35 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289" returned: 0 in 0.993s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:35 devstack sudo[94119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6 1G
Jul 09 09:06:35 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:35 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e91912c1-f95d-4ab1-ad41-b6826bc49c39" returned: 0 in 0.863s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Lock "cinder-quobyte-e91912c1-f95d-4ab1-ad41-b6826bc49c39" released by "delete_volume" :: held 1.921s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:36 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Created reservations ['5ecb953b-0dcf-4c68-9ae7-7b0ff2e61729', 'c8ce1750-7b48-4fbf-ae04-fab854833d59', '50cfa256-c7dc-423c-a89e-9ec16e0708fa', '2ef42c46-e149-4dcc-8d5c-425a2f42105d'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:06:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:06:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:06:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:36 devstack sudo[94125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:06:36 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:36 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6 1G" returned: 0 in 1.235s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bea8943c-3f91-4a16-a73c-ed678361e289 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:36 devstack sudo[94128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bea8943c-3f91-4a16-a73c-ed678361e289 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6
Jul 09 09:06:36 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:37 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.923s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:37 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:06:37 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Deleted volume successfully.
Jul 09 09:06:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-62c1c242-db78-4f17-9069-05dfdb9b934e tempest-SnapshotsActionsTest-497415373 None] Lock "cinder-e91912c1-f95d-4ab1-ad41-b6826bc49c39-delete_volume" released by "delete_volume" :: held 3.247s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:37 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bea8943c-3f91-4a16-a73c-ed678361e289 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6" returned: 0 in 1.019s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:37 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6 is being set with open permissions: ugo+rw
Jul 09 09:06:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:37 devstack sudo[94134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6
Jul 09 09:06:37 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:38 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6" returned: 0 in 0.691s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:38 devstack sudo[94137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.info
Jul 09 09:06:38 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:39 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.info" returned: 0 in 0.692s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:39 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.info is being set with open permissions: ugo+rw
Jul 09 09:06:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:39 devstack sudo[94141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.info
Jul 09 09:06:39 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:39 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.info" returned: 0 in 0.868s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.597s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:39 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-4a3ca3b4-df98-45c9-b9ee-b8c062374164 tempest-VolumesSnapshotTestJSON-1490969048 None] Create snapshot completed successfully
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Flow 'volume_create_manager' (7a0e71ff-db5d-43c2-b85f-730e150ed79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ec9ce3-7ba5-45e1-856e-857b85249717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ec9ce3-7ba5-45e1-856e-857b85249717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-28027515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0156a0de904245aa26d1621db3eea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=efab9c9f-1df4-4d82-b031-71442c2374f6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:06:41Z,use_quota=True,user_id='65afbc10d5514fdd8ce3338fad519d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5973fac5-1258-4d98-94c6-c9d755839b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5973fac5-1258-4d98-94c6-c9d755839b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709f16dc-4195-4db8-8f63-f087030dd61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709f16dc-4195-4db8-8f63-f087030dd61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd', 'volume_name': 'volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd', 'volume_size': 1, 'snapshot_id': 'efab9c9f-1df4-4d82-b031-71442c2374f6'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fdf04f-76d3-4bea-8c57-068f750f52fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fdf04f-76d3-4bea-8c57-068f750f52fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a546494-e91c-474f-b9f1-f4afc40958b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:41 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Volume e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd', 'volume_size': 1, 'snapshot_id': 'efab9c9f-1df4-4d82-b031-71442c2374f6'}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-efab9c9f-1df4-4d82-b031-71442c2374f6-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd" by "_create_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-efab9c9f-1df4-4d82-b031-71442c2374f6-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Creating volume e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd from snapshot efab9c9f-1df4-4d82-b031-71442c2374f6 {{(pid=87009) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd" by "_copy_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] snapshot: efab9c9f-1df4-4d82-b031-71442c2374f6, volume: e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd,  {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[57497d05-59de-42ca-8480-2011192fa7b4]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:41 devstack sudo[94144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6
Jul 09 09:06:41 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:42 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6" returned: 0 in 0.995s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea8943c-3f91-4a16-a73c-ed678361e289(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:06:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] will copy from snapshot at /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289 {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 09:06:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Creating direct copy from snapshot {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 09:06:42 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[969bfa66-0bee-4dff-8a04-766d35241e6b]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:42 devstack sudo[94149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289
Jul 09 09:06:42 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:43 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289" returned: 0 in 0.949s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:43 devstack cinder-volume[87009]: DEBUG cinder.utils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Path /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd not found in is_blk_device check {{(pid=87009) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 09:06:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:43 devstack sudo[94154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd
Jul 09 09:06:43 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:50 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd" returned: 0 in 7.048s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:50 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2337623c-4200-45c0-a9b9-09a523219f6f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:50 devstack sudo[94168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289
Jul 09 09:06:50 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:51 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=74,cinder:INSERT=21,cinder:UPDATE=76,cinder:DELETE=4 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:06:51 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=20,cinder:INSERT=5,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:06:51 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289" returned: 0 in 1.300s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:51 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Image conversion details: src /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289, size 1024.00 MB, duration 7.05 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:06:51 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Converted 1024.00 MB image at 145.26 MB/s
Jul 09 09:06:51 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd is being set with open permissions: ugo+rw
Jul 09 09:06:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:51 devstack sudo[94175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd
Jul 09 09:06:51 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Flow 'volume_create_manager' (ea4d6123-c08b-4513-8cf5-b1e48798b521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25acf0d-9e43-4637-bc56-274f28f203e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25acf0d-9e43-4637-bc56-274f28f203e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-167016370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2888d640-7645-4b55-9c53-656ee1f0104c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc5047fab8646498bd4e2f5a619fc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:06:52Z,use_quota=True,user_id='617efc2b1d9f4e44bfb696732c6f4090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7481ccb-3310-441f-a692-b6a3e99a7743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7481ccb-3310-441f-a692-b6a3e99a7743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f73ae5-f386-46b2-a73a-324504b5e627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f73ae5-f386-46b2-a73a-324504b5e627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2888d640-7645-4b55-9c53-656ee1f0104c', 'volume_name': 'volume-2888d640-7645-4b55-9c53-656ee1f0104c', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a3eecb-9ddf-4d08-9932-09719b4b7e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89a3eecb-9ddf-4d08-9932-09719b4b7e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3442fbba-1665-47d4-bd6b-4f30d726d512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:52 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Volume 2888d640-7645-4b55-9c53-656ee1f0104c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2888d640-7645-4b55-9c53-656ee1f0104c', 'volume_size': 1}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:52 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd" returned: 0 in 0.916s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd" released by "_copy_volume_from_snapshot" :: held 11.336s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-efab9c9f-1df4-4d82-b031-71442c2374f6-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd" released by "_create_volume_from_snapshot" :: held 11.372s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.388s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.431s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-167016370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2888d640-7645-4b55-9c53-656ee1f0104c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc5047fab8646498bd4e2f5a619fc6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:06:52Z,use_quota=True,user_id='617efc2b1d9f4e44bfb696732c6f4090',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Creating volume 2888d640-7645-4b55-9c53-656ee1f0104c {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:06:52 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2888d640-7645-4b55-9c53-656ee1f0104c 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:52 devstack sudo[94178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2888d640-7645-4b55-9c53-656ee1f0104c 1073741824
Jul 09 09:06:52 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a546494-e91c-474f-b9f1-f4afc40958b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd', 'volume_size': 1, 'snapshot_id': 'efab9c9f-1df4-4d82-b031-71442c2374f6'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cddd09-e0e3-4915-ab13-2d2aa075bbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:52 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Volume volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd (e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd): created successfully
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cddd09-e0e3-4915-ab13-2d2aa075bbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Flow 'volume_create_manager' (7a0e71ff-db5d-43c2-b85f-730e150ed79f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:06:52 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b8e1d7a7-35e8-4836-93b0-b1739bd737e2 tempest-VolumesSnapshotTestJSON-1490969048 None] Created volume successfully.
Jul 09 09:06:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:53 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2888d640-7645-4b55-9c53-656ee1f0104c 1073741824" returned: 0 in 1.037s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2888d640-7645-4b55-9c53-656ee1f0104c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:53 devstack sudo[94184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2888d640-7645-4b55-9c53-656ee1f0104c
Jul 09 09:06:53 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:53 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b73d95-7004-4ed7-b9ca-ec9c26f62128]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:06:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:06:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:06:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:54 devstack sudo[94190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:06:54 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:54 devstack sudo[94189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd
Jul 09 09:06:54 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:54 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2888d640-7645-4b55-9c53-656ee1f0104c" returned: 0 in 0.951s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:06:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3442fbba-1665-47d4-bd6b-4f30d726d512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2888d640-7645-4b55-9c53-656ee1f0104c', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd34ac0f-78dd-4f6d-a27f-edda7b384b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:06:54 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Volume volume-2888d640-7645-4b55-9c53-656ee1f0104c (2888d640-7645-4b55-9c53-656ee1f0104c): created successfully
Jul 09 09:06:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd34ac0f-78dd-4f6d-a27f-edda7b384b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:06:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Flow 'volume_create_manager' (ea4d6123-c08b-4513-8cf5-b1e48798b521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:06:54 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6953c6e6-7bee-4d34-9ea6-5990c0b7a519 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Created volume successfully.
Jul 09 09:06:55 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.055s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:06:55 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:06:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:06:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:06:55 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd" returned: 0 in 1.197s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:55 devstack sudo[94199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd
Jul 09 09:06:55 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:55 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd" returned: 0 in 0.750s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd" released by "delete_volume" :: held 2.021s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Created reservations ['2bae07aa-0ed3-455f-befd-d60700c88cee', 'f1ffcbe4-b50a-4b6d-9d03-bed46af92498', 'dbae742d-360a-45da-b732-49bff2963561', '4f47d4ea-9628-4f79-9d92-7db153b7b8e0'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:56 devstack sudo[94202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:06:56 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-efab9c9f-1df4-4d82-b031-71442c2374f6-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-efab9c9f-1df4-4d82-b031-71442c2374f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-bea8943c-3f91-4a16-a73c-ed678361e289" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-bea8943c-3f91-4a16-a73c-ed678361e289" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-efab9c9f-1df4-4d82-b031-71442c2374f6" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-efab9c9f-1df4-4d82-b031-71442c2374f6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Deleting offline snapshot efab9c9f-1df4-4d82-b031-71442c2374f6 of volume bea8943c-3f91-4a16-a73c-ed678361e289 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] snapshot_file for this snap is: volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e468486-e1e1-41dc-8614-23ee8ed34432]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:56 devstack sudo[94204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6
Jul 09 09:06:56 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Acquiring lock "cinder-2888d640-7645-4b55-9c53-656ee1f0104c-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Lock "cinder-2888d640-7645-4b55-9c53-656ee1f0104c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Acquiring lock "cinder-quobyte-2888d640-7645-4b55-9c53-656ee1f0104c" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Lock "cinder-quobyte-2888d640-7645-4b55-9c53-656ee1f0104c" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1e6523-f885-4fb2-bacc-a6f1caaf7cb7]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2888d640-7645-4b55-9c53-656ee1f0104c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:56 devstack sudo[94206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2888d640-7645-4b55-9c53-656ee1f0104c
Jul 09 09:06:56 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:57 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.782s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:57 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:06:57 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Deleted volume successfully.
Jul 09 09:06:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2d6d4f2d-8ce8-4ec4-9fd3-4b90e97b674b tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-e06d1b61-06ee-4b4f-b1d0-5a5cd33215fd-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:57 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6" returned: 0 in 0.991s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea8943c-3f91-4a16-a73c-ed678361e289(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:06:57 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a92f9a-f313-43ae-8812-06a0975c9a8d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:06:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:57 devstack sudo[94213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289
Jul 09 09:06:57 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:57 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2888d640-7645-4b55-9c53-656ee1f0104c" returned: 0 in 0.873s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2888d640-7645-4b55-9c53-656ee1f0104c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:57 devstack sudo[94217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2888d640-7645-4b55-9c53-656ee1f0104c
Jul 09 09:06:57 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:58 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289" returned: 0 in 0.884s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:58 devstack sudo[94223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6
Jul 09 09:06:58 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:58 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2888d640-7645-4b55-9c53-656ee1f0104c" returned: 0 in 0.805s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Lock "cinder-quobyte-2888d640-7645-4b55-9c53-656ee1f0104c" released by "delete_volume" :: held 1.727s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:06:58 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Created reservations ['71d7ca7d-90fe-4c53-ab59-46c51da18f99', 'ed8cbdbf-4409-43ef-aafb-32a6ced1b063', '14f9e713-5a04-4e88-ab7a-01bcbf28689b', 'c2c29cc9-0211-4302-bda4-92b5e7dbe32d'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:06:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:06:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:06:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:06:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:06:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:06:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:58 devstack sudo[94226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:06:58 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:59 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6" returned: 0 in 1.156s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:06:59 devstack sudo[94232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6
Jul 09 09:06:59 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:06:59 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root
Jul 09 09:06:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.074s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:06:59 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:06:59 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Deleted volume successfully.
Jul 09 09:06:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d31d6484-483c-4436-b550-f3ed2bd63544 tempest-VolumeQuotasNegativeTestJSON-27284248 None] Lock "cinder-2888d640-7645-4b55-9c53-656ee1f0104c-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:07:00 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289.efab9c9f-1df4-4d82-b031-71442c2374f6" returned: 0 in 0.859s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-efab9c9f-1df4-4d82-b031-71442c2374f6" released by "_delete_snapshot" :: held 4.049s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:07:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-bea8943c-3f91-4a16-a73c-ed678361e289" released by "delete_snapshot" :: held 4.085s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:07:00 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Created reservations ['365fbcdb-458a-45b7-818e-a2cc6c353ea1', '581d4384-1dcb-4d37-9618-39e0b620962a', '03b1db3a-7339-4be2-99bd-6bb9c2548f5c', 'bbe89956-a122-4fab-82fa-910fdfb30972'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:07:00 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Delete snapshot completed successfully.
Jul 09 09:07:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0aaddd62-3c47-42cd-8c47-abaaa6a95564 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-efab9c9f-1df4-4d82-b031-71442c2374f6-delete_snapshot" released by "delete_snapshot" :: held 4.296s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:07:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-bea8943c-3f91-4a16-a73c-ed678361e289-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:07:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-bea8943c-3f91-4a16-a73c-ed678361e289-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:07:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-bea8943c-3f91-4a16-a73c-ed678361e289" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:07:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-bea8943c-3f91-4a16-a73c-ed678361e289" acquired by "delete_volume" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:07:01 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dcf81c-e2ed-42d7-a33a-a9db128fbcfc]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:07:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:02 devstack sudo[94254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289
Jul 09 09:07:02 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:02 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289" returned: 0 in 1.070s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:02 devstack sudo[94259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289
Jul 09 09:07:02 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:03 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bea8943c-3f91-4a16-a73c-ed678361e289" returned: 0 in 0.813s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-bea8943c-3f91-4a16-a73c-ed678361e289" released by "delete_volume" :: held 1.963s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:07:03 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Created reservations ['045addb5-0a0f-4f3d-878f-874ade34270d', 'f7c00372-2510-497a-b733-267c40237b66', '6e56c2c4-972b-483c-8a04-6ea0af3a8e8a', '0a141427-c60a-40de-9ab8-4136b6c91608'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:07:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:03 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:07:03 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:07:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:04 devstack sudo[94262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:07:04 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-15247ba5-afb1-4723-8fa0-8e6a552cec75-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:07:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-15247ba5-afb1-4723-8fa0-8e6a552cec75-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:07:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "cinder-quobyte-15247ba5-afb1-4723-8fa0-8e6a552cec75" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:07:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-15247ba5-afb1-4723-8fa0-8e6a552cec75" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:07:04 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf07334-cdf8-4fc2-8fa2-ec975ab78afe]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:07:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:04 devstack sudo[94264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75
Jul 09 09:07:04 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:05 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.196s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:05 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:07:05 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Deleted volume successfully.
Jul 09 09:07:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-86cbb695-e2b3-439a-924d-15557ff56649 tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-bea8943c-3f91-4a16-a73c-ed678361e289-delete_volume" released by "delete_volume" :: held 3.463s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:07:05 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75" returned: 0 in 1.180s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:05 devstack sudo[94270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75
Jul 09 09:07:05 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:06 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-15247ba5-afb1-4723-8fa0-8e6a552cec75" returned: 0 in 1.142s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-quobyte-15247ba5-afb1-4723-8fa0-8e6a552cec75" released by "delete_volume" :: held 2.401s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:07:06 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Created reservations ['327b8b18-d163-4612-9b42-830f2e7ad85e', '6ca33cf9-77f2-4181-8d00-e4e2e590c4ec', 'b3eb5f88-f69d-408c-ac54-e3f4db28d3ca', '3e563096-59f0-46a2-b0a7-e39028c15d3e'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:07:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:07:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:07:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:07 devstack sudo[94274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:07:07 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:07 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.809s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:07 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:07:07 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Deleted volume successfully.
Jul 09 09:07:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c8dac74f-1d0e-4f76-9a75-6a558e126a8d tempest-VolumesSnapshotTestJSON-1490969048 None] Lock "cinder-15247ba5-afb1-4723-8fa0-8e6a552cec75-delete_volume" released by "delete_volume" :: held 3.532s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Flow 'volume_create_manager' (6267bd1e-a4b9-4621-b840-d67fee39dc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdca968f-8717-4cf0-8f3d-c6afc6de0fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdca968f-8717-4cf0-8f3d-c6afc6de0fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1046520533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48882e3b-33a8-4769-9f09-adc16a8feaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f7215b9f0045a48410ccde67d3ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:09Z,use_quota=True,user_id='58391e8d375f4045957535c416d1834a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd98fb53-a42a-40f0-a9d9-94058d763724),volume_type_id=dd98fb53-a42a-40f0-a9d9-94058d763724)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fabefcc-55de-4ab7-aebc-2835aa5b1773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fabefcc-55de-4ab7-aebc-2835aa5b1773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abefb75-f9e8-4aa9-96ae-be2f45e4867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abefb75-f9e8-4aa9-96ae-be2f45e4867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48882e3b-33a8-4769-9f09-adc16a8feaad', 'volume_name': 'volume-48882e3b-33a8-4769-9f09-adc16a8feaad', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89648fea-4838-447e-af0b-43e643c63058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89648fea-4838-447e-af0b-43e643c63058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69f3d6d-cbbb-4649-9353-6d92569e3ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:08 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Volume 48882e3b-33a8-4769-9f09-adc16a8feaad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48882e3b-33a8-4769-9f09-adc16a8feaad', 'volume_size': 1}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1046520533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48882e3b-33a8-4769-9f09-adc16a8feaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f7215b9f0045a48410ccde67d3ab78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:09Z,use_quota=True,user_id='58391e8d375f4045957535c416d1834a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd98fb53-a42a-40f0-a9d9-94058d763724),volume_type_id=dd98fb53-a42a-40f0-a9d9-94058d763724)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Creating volume 48882e3b-33a8-4769-9f09-adc16a8feaad {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:07:08 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:07:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-48882e3b-33a8-4769-9f09-adc16a8feaad 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:08 devstack sudo[94279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-48882e3b-33a8-4769-9f09-adc16a8feaad 1073741824
Jul 09 09:07:08 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:09 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-48882e3b-33a8-4769-9f09-adc16a8feaad 1073741824" returned: 0 in 1.132s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-48882e3b-33a8-4769-9f09-adc16a8feaad {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:09 devstack sudo[94290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-48882e3b-33a8-4769-9f09-adc16a8feaad
Jul 09 09:07:09 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:10 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-48882e3b-33a8-4769-9f09-adc16a8feaad" returned: 0 in 0.899s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:07:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69f3d6d-cbbb-4649-9353-6d92569e3ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48882e3b-33a8-4769-9f09-adc16a8feaad', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43db1e1f-3b2c-4da9-8e6c-6f4be5f4301d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:10 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Volume volume-48882e3b-33a8-4769-9f09-adc16a8feaad (48882e3b-33a8-4769-9f09-adc16a8feaad): created successfully
Jul 09 09:07:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43db1e1f-3b2c-4da9-8e6c-6f4be5f4301d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Flow 'volume_create_manager' (6267bd1e-a4b9-4621-b840-d67fee39dc02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-1edf7ee7-930b-423e-8d07-ed24e5243714 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Created volume successfully.
Jul 09 09:07:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f7680bd8-e924-4872-9561-522a6edfcbeb tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f7680bd8-e924-4872-9561-522a6edfcbeb tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f7680bd8-e924-4872-9561-522a6edfcbeb tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:07:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f7680bd8-e924-4872-9561-522a6edfcbeb tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:07:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f7680bd8-e924-4872-9561-522a6edfcbeb tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f7680bd8-e924-4872-9561-522a6edfcbeb tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:12 devstack sudo[94356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:07:12 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:13 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f7680bd8-e924-4872-9561-522a6edfcbeb tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.816s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:13 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-f7680bd8-e924-4872-9561-522a6edfcbeb tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:07:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f7680bd8-e924-4872-9561-522a6edfcbeb tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Retype volume completed successfully.
Jul 09 09:07:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Acquiring lock "cinder-48882e3b-33a8-4769-9f09-adc16a8feaad-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:07:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Lock "cinder-48882e3b-33a8-4769-9f09-adc16a8feaad-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:07:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Acquiring lock "cinder-quobyte-48882e3b-33a8-4769-9f09-adc16a8feaad" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:07:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Lock "cinder-quobyte-48882e3b-33a8-4769-9f09-adc16a8feaad" acquired by "delete_volume" :: waited 0.041s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:07:14 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd27076-d07c-4a0d-b5b9-4eb01870d810]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:07:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-48882e3b-33a8-4769-9f09-adc16a8feaad {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:14 devstack sudo[94364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-48882e3b-33a8-4769-9f09-adc16a8feaad
Jul 09 09:07:14 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:15 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-48882e3b-33a8-4769-9f09-adc16a8feaad" returned: 0 in 1.582s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-48882e3b-33a8-4769-9f09-adc16a8feaad {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:15 devstack sudo[94369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-48882e3b-33a8-4769-9f09-adc16a8feaad
Jul 09 09:07:15 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:16 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-48882e3b-33a8-4769-9f09-adc16a8feaad" returned: 0 in 1.180s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Lock "cinder-quobyte-48882e3b-33a8-4769-9f09-adc16a8feaad" released by "delete_volume" :: held 2.872s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:07:17 devstack cinder-volume[87009]: WARNING cinder.quota [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:07:17 devstack cinder-volume[87009]: WARNING cinder.quota [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:07:17 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Created reservations ['dd79a32a-bf2c-40dc-9ea6-15e3676165ab', 'b59236b1-33d8-41cc-8030-49d7b2f346ab', '6bc07184-0439-45ef-9fdd-72061ef76ea5', '153edfc3-78b2-44c4-be13-dbcb8775798f'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:07:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:07:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:07:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:17 devstack sudo[94407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:07:17 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:18 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.438s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:18 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:07:18 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Deleted volume successfully.
Jul 09 09:07:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ba19554-fbe2-4a17-9e6a-5403d54427e4 tempest-VolumeRetypeWithoutMigrationTest-1504661263 None] Lock "cinder-48882e3b-33a8-4769-9f09-adc16a8feaad-delete_volume" released by "delete_volume" :: held 4.865s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:07:27 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=45,cinder:UPDATE=62,cinder:INSERT=14 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=39,cinder:UPDATE=53,cinder:DELETE=8,cinder:INSERT=12 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Flow 'volume_create_manager' (456e4961-ad1d-4b72-b3c7-41a97551683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aad5e6f-1278-4ac0-8809-1da76eb7ad79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aad5e6f-1278-4ac0-8809-1da76eb7ad79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-870372916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278b8b1b-ece4-42d9-8325-9dd95903c97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d1444e9a2a0470f91e2aeb0620edb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:29Z,use_quota=True,user_id='18593a6c39e5465e93db657508ca0da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(358d56ea-8811-4e88-acbd-ba11be5cf98a),volume_type_id=358d56ea-8811-4e88-acbd-ba11be5cf98a)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38da9c98-5a59-4b49-a13f-389fabdc4eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38da9c98-5a59-4b49-a13f-389fabdc4eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4be3ec-cfc5-4ba8-977a-9b8c24c57ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4be3ec-cfc5-4ba8-977a-9b8c24c57ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '278b8b1b-ece4-42d9-8325-9dd95903c97e', 'volume_name': 'volume-278b8b1b-ece4-42d9-8325-9dd95903c97e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0b7c66-e485-44b9-b36a-c6b2e932801a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0b7c66-e485-44b9-b36a-c6b2e932801a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ab3291-3760-4388-99e2-cfabf7876d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:28 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Volume 278b8b1b-ece4-42d9-8325-9dd95903c97e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-278b8b1b-ece4-42d9-8325-9dd95903c97e', 'volume_size': 1}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-870372916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278b8b1b-ece4-42d9-8325-9dd95903c97e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d1444e9a2a0470f91e2aeb0620edb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:29Z,use_quota=True,user_id='18593a6c39e5465e93db657508ca0da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(358d56ea-8811-4e88-acbd-ba11be5cf98a),volume_type_id=358d56ea-8811-4e88-acbd-ba11be5cf98a)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Creating volume 278b8b1b-ece4-42d9-8325-9dd95903c97e {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:07:28 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:07:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-278b8b1b-ece4-42d9-8325-9dd95903c97e 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:29 devstack sudo[94537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-278b8b1b-ece4-42d9-8325-9dd95903c97e 1073741824
Jul 09 09:07:29 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:30 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-278b8b1b-ece4-42d9-8325-9dd95903c97e 1073741824" returned: 0 in 1.363s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-278b8b1b-ece4-42d9-8325-9dd95903c97e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:30 devstack sudo[94543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-278b8b1b-ece4-42d9-8325-9dd95903c97e
Jul 09 09:07:30 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:31 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-278b8b1b-ece4-42d9-8325-9dd95903c97e" returned: 0 in 0.898s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] <== create_volume: return (2401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.404s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ab3291-3760-4388-99e2-cfabf7876d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-278b8b1b-ece4-42d9-8325-9dd95903c97e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10124481-ea30-4b82-be4f-2bac1655bc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:31 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Volume volume-278b8b1b-ece4-42d9-8325-9dd95903c97e (278b8b1b-ece4-42d9-8325-9dd95903c97e): created successfully
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10124481-ea30-4b82-be4f-2bac1655bc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Flow 'volume_create_manager' (456e4961-ad1d-4b72-b3c7-41a97551683b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:31 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d05cab7f-8070-4a09-b543-93be0fcf9102 tempest-VolumeTypesAccessTest-676238150 None] Created volume successfully.
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Flow 'volume_create_manager' (1419e4bf-68e9-4272-b17d-282aae133451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a647e1-f198-4238-ba27-6557a5e0c2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a647e1-f198-4238-ba27-6557a5e0c2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1920171357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed25e79-8d1f-406a-b44b-e9a45ab037a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34be47c860954c50ad42c61562363367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:31Z,use_quota=True,user_id='2f9ca90ef0ec49b181ba29425d262306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0a8ad5-02c1-451a-b334-76e7e59f2000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0a8ad5-02c1-451a-b334-76e7e59f2000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3782b3cb-8268-48dd-9dd4-e99c8db8c2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3782b3cb-8268-48dd-9dd4-e99c8db8c2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed25e79-8d1f-406a-b44b-e9a45ab037a5', 'volume_name': 'volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1026e4-47b7-4bc2-96da-edcf17ddf378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1026e4-47b7-4bc2-96da-edcf17ddf378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f292dc66-9aa7-4bc3-b069-735b9c28a7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:31 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Volume eed25e79-8d1f-406a-b44b-e9a45ab037a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5', 'volume_size': 1}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1920171357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed25e79-8d1f-406a-b44b-e9a45ab037a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34be47c860954c50ad42c61562363367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:31Z,use_quota=True,user_id='2f9ca90ef0ec49b181ba29425d262306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Creating volume eed25e79-8d1f-406a-b44b-e9a45ab037a5 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:07:31 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:07:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:31 devstack sudo[94546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5 1073741824
Jul 09 09:07:31 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Acquiring lock "cinder-278b8b1b-ece4-42d9-8325-9dd95903c97e-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:07:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Lock "cinder-278b8b1b-ece4-42d9-8325-9dd95903c97e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:07:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Acquiring lock "cinder-quobyte-278b8b1b-ece4-42d9-8325-9dd95903c97e" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:07:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Lock "cinder-quobyte-278b8b1b-ece4-42d9-8325-9dd95903c97e" acquired by "delete_volume" :: waited 0.047s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:07:32 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0a2d46-658d-43b6-b91b-311285da3a2a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:07:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-278b8b1b-ece4-42d9-8325-9dd95903c97e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:32 devstack sudo[94557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-278b8b1b-ece4-42d9-8325-9dd95903c97e
Jul 09 09:07:32 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:32 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5 1073741824" returned: 0 in 1.439s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:33 devstack sudo[94559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5
Jul 09 09:07:33 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:33 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-278b8b1b-ece4-42d9-8325-9dd95903c97e" returned: 0 in 1.305s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-278b8b1b-ece4-42d9-8325-9dd95903c97e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:33 devstack sudo[94564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-278b8b1b-ece4-42d9-8325-9dd95903c97e
Jul 09 09:07:33 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:34 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5" returned: 0 in 1.251s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:34 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] <== create_volume: return (2764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:07:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.768s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f292dc66-9aa7-4bc3-b069-735b9c28a7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7350a55d-ed6f-424d-b05b-df1d5dce3a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:34 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Volume volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5 (eed25e79-8d1f-406a-b44b-e9a45ab037a5): created successfully
Jul 09 09:07:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7350a55d-ed6f-424d-b05b-df1d5dce3a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Flow 'volume_create_manager' (1419e4bf-68e9-4272-b17d-282aae133451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:34 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-33255f70-5e0a-441f-b1da-75a2ffc6fcdf tempest-TestMinimumBasicScenario-1049986500 None] Created volume successfully.
Jul 09 09:07:34 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-278b8b1b-ece4-42d9-8325-9dd95903c97e" returned: 0 in 0.934s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Lock "cinder-quobyte-278b8b1b-ece4-42d9-8325-9dd95903c97e" released by "delete_volume" :: held 2.308s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:07:34 devstack cinder-volume[87009]: WARNING cinder.quota [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1111197709 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1111197709, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:07:34 devstack cinder-volume[87009]: WARNING cinder.quota [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1111197709 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1111197709, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:07:34 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Created reservations ['a532ad11-7dd4-41e6-b76b-a6220d5e15af', 'aa78ad88-319c-40c9-83fb-2c472fe0a902', 'a0684788-0a4c-4584-a179-6053bc06868d', '8f56d041-b737-441a-93dd-ed5e4c709b20'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:07:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:07:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:07:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:35 devstack sudo[94568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:07:35 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:36 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.165s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:36 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:07:36 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Deleted volume successfully.
Jul 09 09:07:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-69921992-0d71-448d-8931-3ab1201ee338 tempest-VolumeTypesAccessTest-676238150 None] Lock "cinder-278b8b1b-ece4-42d9-8325-9dd95903c97e-delete_volume" released by "delete_volume" :: held 4.047s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:07:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-3c8e18c3-18cc-4919-ad09-c3a0998d93a2 req-1380edad-4bca-456e-98c3-06f0fabff9af tempest-TestMinimumBasicScenario-1049986500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-3c8e18c3-18cc-4919-ad09-c3a0998d93a2 req-1380edad-4bca-456e-98c3-06f0fabff9af tempest-TestMinimumBasicScenario-1049986500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:39 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a11559-675d-4388-b7c7-eccb471854c6]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:07:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-3c8e18c3-18cc-4919-ad09-c3a0998d93a2 req-1380edad-4bca-456e-98c3-06f0fabff9af tempest-TestMinimumBasicScenario-1049986500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:39 devstack sudo[94585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5
Jul 09 09:07:39 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:40 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-3c8e18c3-18cc-4919-ad09-c3a0998d93a2 req-1380edad-4bca-456e-98c3-06f0fabff9af tempest-TestMinimumBasicScenario-1049986500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5" returned: 0 in 1.444s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-3c8e18c3-18cc-4919-ad09-c3a0998d93a2 req-1380edad-4bca-456e-98c3-06f0fabff9af tempest-TestMinimumBasicScenario-1049986500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.488s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-3c8e18c3-18cc-4919-ad09-c3a0998d93a2 req-1380edad-4bca-456e-98c3-06f0fabff9af tempest-TestMinimumBasicScenario-1049986500 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '725f0242-d9e7-4d58-bf0f-275bb22c905d', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:07:40 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-3c8e18c3-18cc-4919-ad09-c3a0998d93a2 req-1380edad-4bca-456e-98c3-06f0fabff9af tempest-TestMinimumBasicScenario-1049986500 None] attachment_update completed successfully.
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Flow 'volume_create_manager' (e6d4c948-2630-41b6-aaf7-68dfc0346028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d24cd3c3-e4c1-4255-bda5-f89006740d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d24cd3c3-e4c1-4255-bda5-f89006740d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1903017851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5685b47-376a-47cf-b1b5-e0944bcb46a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c6222df283401caca446fdb53a45de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:41Z,use_quota=True,user_id='ba1d93647a4f45a4ad99cfcbf7e452a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32429b33-e5c0-4735-be49-8dbed0d0478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32429b33-e5c0-4735-be49-8dbed0d0478d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b03233-5a0f-4100-97ff-c0ef021b3580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b03233-5a0f-4100-97ff-c0ef021b3580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5685b47-376a-47cf-b1b5-e0944bcb46a6', 'volume_name': 'volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab40ecab-5dda-42e0-a79c-2c2b9fc69bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab40ecab-5dda-42e0-a79c-2c2b9fc69bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cbb0a6-6355-4062-9ed3-1ee5a4ae264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:41 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Volume d5685b47-376a-47cf-b1b5-e0944bcb46a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6', 'volume_size': 1}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1903017851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5685b47-376a-47cf-b1b5-e0944bcb46a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c6222df283401caca446fdb53a45de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:41Z,use_quota=True,user_id='ba1d93647a4f45a4ad99cfcbf7e452a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Creating volume d5685b47-376a-47cf-b1b5-e0944bcb46a6 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:07:41 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:07:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:41 devstack sudo[94643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6 1073741824
Jul 09 09:07:41 devstack sudo[94643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:42 devstack sudo[94643]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6 1073741824" returned: 0 in 1.147s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:42 devstack sudo[95010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6
Jul 09 09:07:42 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:43 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6" returned: 0 in 0.765s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:07:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cbb0a6-6355-4062-9ed3-1ee5a4ae264e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57aa7d8b-a492-412f-9fd0-d8bb2ad32d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:43 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Volume volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6 (d5685b47-376a-47cf-b1b5-e0944bcb46a6): created successfully
Jul 09 09:07:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57aa7d8b-a492-412f-9fd0-d8bb2ad32d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Flow 'volume_create_manager' (e6d4c948-2630-41b6-aaf7-68dfc0346028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:43 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-0b52d2be-68b2-4e4d-ad30-dbf0983e8018 tempest-AttachVolumeTestJSON-2089683209 None] Created volume successfully.
Jul 09 09:07:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-601ffcc7-c55a-41d4-a377-4a33089d6b7b req-7decc3d4-43ca-4f6a-a9fd-2ed7fd13dd5e tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-601ffcc7-c55a-41d4-a377-4a33089d6b7b req-7decc3d4-43ca-4f6a-a9fd-2ed7fd13dd5e tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:48 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b5a0eb-0c0e-4f98-ae4e-509749ccfe8d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:07:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-601ffcc7-c55a-41d4-a377-4a33089d6b7b req-7decc3d4-43ca-4f6a-a9fd-2ed7fd13dd5e tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:48 devstack sudo[95031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6
Jul 09 09:07:48 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:49 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-601ffcc7-c55a-41d4-a377-4a33089d6b7b req-7decc3d4-43ca-4f6a-a9fd-2ed7fd13dd5e tempest-AttachVolumeTestJSON-2089683209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6" returned: 0 in 1.030s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-601ffcc7-c55a-41d4-a377-4a33089d6b7b req-7decc3d4-43ca-4f6a-a9fd-2ed7fd13dd5e tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.068s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-601ffcc7-c55a-41d4-a377-4a33089d6b7b req-7decc3d4-43ca-4f6a-a9fd-2ed7fd13dd5e tempest-AttachVolumeTestJSON-2089683209 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5cb8df72-cf76-4293-8f9a-78ae7b3cc149', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:07:49 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-601ffcc7-c55a-41d4-a377-4a33089d6b7b req-7decc3d4-43ca-4f6a-a9fd-2ed7fd13dd5e tempest-AttachVolumeTestJSON-2089683209 None] attachment_update completed successfully.
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Flow 'volume_create_manager' (e8f7c19f-ed14-4051-99e0-aaa45c1f0112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dab8414-665d-4baf-8845-6e8cdda833f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dab8414-665d-4baf-8845-6e8cdda833f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-63837689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ed35d9-acce-4fc7-bea8-5c2e51b28dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c3980b89da4dafa5ec7c07a66b64d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:51Z,use_quota=True,user_id='82cc45932c514d47bb20afa23ea1bc7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8daa0222-01fa-4d88-80a4-3d3e4f52881a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8daa0222-01fa-4d88-80a4-3d3e4f52881a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0171f508-d9c2-4594-a4ce-e736e351a9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0171f508-d9c2-4594-a4ce-e736e351a9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30ed35d9-acce-4fc7-bea8-5c2e51b28dd0', 'volume_name': 'volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9362151-82cd-4b4e-b814-7e3c03cf11fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9362151-82cd-4b4e-b814-7e3c03cf11fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeff9237-eb2c-4b62-a8c5-574de5de799a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:51 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Volume 30ed35d9-acce-4fc7-bea8-5c2e51b28dd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0', 'volume_size': 1}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-63837689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ed35d9-acce-4fc7-bea8-5c2e51b28dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c3980b89da4dafa5ec7c07a66b64d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:51Z,use_quota=True,user_id='82cc45932c514d47bb20afa23ea1bc7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Creating volume 30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:07:51 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:51 devstack sudo[95041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 1073741824
Jul 09 09:07:51 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Flow 'volume_create_manager' (6084f173-686f-4247-b162-60a02f2338a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9867204-b411-4455-bc07-369792d8cbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9867204-b411-4455-bc07-369792d8cbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2106763492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85201daa-3dfb-4796-af90-132781538ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5073945580d4493bc26e16f05741abf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:52Z,use_quota=True,user_id='a4067b5a32714844b9d8f1e716f9e131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75ad2b61-3153-4ed0-8590-311f9993a261),volume_type_id=75ad2b61-3153-4ed0-8590-311f9993a261)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e28438-77f0-44a0-ba0b-e59c661fa262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e28438-77f0-44a0-ba0b-e59c661fa262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0056cd5-3c05-4125-beff-d3d5fdda9d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0056cd5-3c05-4125-beff-d3d5fdda9d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85201daa-3dfb-4796-af90-132781538ab6', 'volume_name': 'volume-85201daa-3dfb-4796-af90-132781538ab6', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30aa278-c34e-4897-b027-a69468122699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30aa278-c34e-4897-b027-a69468122699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d53260-9c74-45c5-9474-2b4dee59f143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:51 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Volume 85201daa-3dfb-4796-af90-132781538ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85201daa-3dfb-4796-af90-132781538ab6', 'volume_size': 1}
Jul 09 09:07:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:52 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:07:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Flow 'volume_create_manager' (10353994-2f3e-4ad9-bbea-b751def42e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea170cc-c0ae-46fe-8509-7c1473a79db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:52 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 1073741824" returned: 0 in 1.068s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea170cc-c0ae-46fe-8509-7c1473a79db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-168151495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712fe0e5-9e1c-4fcc-a300-020a3a539f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5073945580d4493bc26e16f05741abf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:52Z,use_quota=True,user_id='a4067b5a32714844b9d8f1e716f9e131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f564db0f-3a2f-42ee-b606-4dfdb60bdf0d),volume_type_id=f564db0f-3a2f-42ee-b606-4dfdb60bdf0d)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1abab5d-380e-4def-9cc5-c384cd4437c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1abab5d-380e-4def-9cc5-c384cd4437c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af638a2c-a0d4-4c5c-a666-1ee0cebcef81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af638a2c-a0d4-4c5c-a666-1ee0cebcef81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '712fe0e5-9e1c-4fcc-a300-020a3a539f81', 'volume_name': 'volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09825d85-cd2c-4112-8625-734efdb2cc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09825d85-cd2c-4112-8625-734efdb2cc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca256ec-214a-444f-87d6-049bb4df2820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:52 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Volume 712fe0e5-9e1c-4fcc-a300-020a3a539f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81', 'volume_size': 1}
Jul 09 09:07:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:52 devstack sudo[95047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0
Jul 09 09:07:52 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Flow 'volume_create_manager' (46481195-1b9b-4480-9adb-c1efb83a9d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7368a475-76f9-4c43-abf9-19d04b4d400e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7368a475-76f9-4c43-abf9-19d04b4d400e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1140545165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f16e03b-694c-4d39-ab4f-a902515975d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5073945580d4493bc26e16f05741abf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:53Z,use_quota=True,user_id='a4067b5a32714844b9d8f1e716f9e131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76c98afd-a0d3-4168-a855-d62c8d8b5ded),volume_type_id=76c98afd-a0d3-4168-a855-d62c8d8b5ded)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf11e1f-82da-4f40-95e3-406b9e3598a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf11e1f-82da-4f40-95e3-406b9e3598a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73544753-0269-430a-a09a-872ef539fcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.image.glance [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Creating Keystone auth plugin from conf {{(pid=87009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 09:07:53 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0" returned: 0 in 0.884s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.517s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2106763492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85201daa-3dfb-4796-af90-132781538ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5073945580d4493bc26e16f05741abf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:52Z,use_quota=True,user_id='a4067b5a32714844b9d8f1e716f9e131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75ad2b61-3153-4ed0-8590-311f9993a261),volume_type_id=75ad2b61-3153-4ed0-8590-311f9993a261)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Creating volume 85201daa-3dfb-4796-af90-132781538ab6 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:07:53 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeff9237-eb2c-4b62-a8c5-574de5de799a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:53 devstack sudo[95052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6 1073741824
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2b0f79-4db0-41f9-b752-ab9d1e65ced4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:53 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:53 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Volume volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 (30ed35d9-acce-4fc7-bea8-5c2e51b28dd0): created successfully
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2b0f79-4db0-41f9-b752-ab9d1e65ced4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Flow 'volume_create_manager' (e8f7c19f-ed14-4051-99e0-aaa45c1f0112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:53 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-02c74d4e-7a80-411e-bcdd-fc48c7d01aa6 tempest-SnapshotMetadataTestJSON-739678972 None] Created volume successfully.
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73544753-0269-430a-a09a-872ef539fcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f16e03b-694c-4d39-ab4f-a902515975d1', 'volume_name': 'volume-9f16e03b-694c-4d39-ab4f-a902515975d1', 'volume_size': 1, 'image_id': 'c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--990731123', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5073945580d4493bc26e16f05741abf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7', 'created_at': datetime.datetime(2026, 7, 9, 7, 7, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 7, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc5903cf860>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e68b3de-78ef-4f5d-bbb4-d8a21940241a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e68b3de-78ef-4f5d-bbb4-d8a21940241a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e8e612-e5c9-4be8-aff2-556e28806845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:53 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Volume 9f16e03b-694c-4d39-ab4f-a902515975d1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f16e03b-694c-4d39-ab4f-a902515975d1', 'volume_size': 1, 'image_id': 'c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--990731123', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5073945580d4493bc26e16f05741abf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7', 'created_at': datetime.datetime(2026, 7, 9, 7, 7, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 7, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc5903cf860>}
Jul 09 09:07:53 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Trying to clone 9f16e03b-694c-4d39-ab4f-a902515975d1 from image c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7', 'metadata': {}}]). {{(pid=87009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 09:07:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:07:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:07:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:07:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:54 devstack sudo[95057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:07:54 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:54 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6 1073741824" returned: 0 in 1.465s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:54 devstack sudo[95071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6
Jul 09 09:07:54 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:55 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.252s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:07:55 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:07:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:07:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:07:56 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6" returned: 0 in 1.104s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] <== create_volume: return (2662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.668s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.618s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-168151495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712fe0e5-9e1c-4fcc-a300-020a3a539f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5073945580d4493bc26e16f05741abf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:52Z,use_quota=True,user_id='a4067b5a32714844b9d8f1e716f9e131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f564db0f-3a2f-42ee-b606-4dfdb60bdf0d),volume_type_id=f564db0f-3a2f-42ee-b606-4dfdb60bdf0d)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Creating volume 712fe0e5-9e1c-4fcc-a300-020a3a539f81 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:07:56 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:56 devstack sudo[95086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81 1073741824
Jul 09 09:07:56 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d53260-9c74-45c5-9474-2b4dee59f143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85201daa-3dfb-4796-af90-132781538ab6', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38830f7-81ea-442c-a356-f165e5f03a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:56 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Volume volume-85201daa-3dfb-4796-af90-132781538ab6 (85201daa-3dfb-4796-af90-132781538ab6): created successfully
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38830f7-81ea-442c-a356-f165e5f03a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Flow 'volume_create_manager' (6084f173-686f-4247-b162-60a02f2338a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:56 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6642eeeb-5392-4990-863c-375869181694 tempest-TestInstancesWithCinderVolumes-1780519803 None] Created volume successfully.
Jul 09 09:07:56 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81 1073741824" returned: 0 in 0.957s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:57 devstack sudo[95098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81
Jul 09 09:07:57 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:57 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81" returned: 0 in 0.761s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:07:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:07:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.886s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:07:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] Creating offline snapshot 2c07807d-3482-4750-9f3d-10e52e48218e of volume 30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:07:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca256ec-214a-444f-87d6-049bb4df2820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1d3b88-d7d5-42fb-8947-ab725334e105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:07:57 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5d9df6-319f-4a8d-a0ea-04d8e703e37f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:07:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:57 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Volume volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81 (712fe0e5-9e1c-4fcc-a300-020a3a539f81): created successfully
Jul 09 09:07:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1d3b88-d7d5-42fb-8947-ab725334e105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:07:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Flow 'volume_create_manager' (10353994-2f3e-4ad9-bbea-b751def42e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:07:57 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b810afbb-22d6-48ec-82fc-26566adda565 tempest-TestInstancesWithCinderVolumes-1780519803 None] Created volume successfully.
Jul 09 09:07:57 devstack sudo[95101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0
Jul 09 09:07:57 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:58 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_30g48db3devstack@QuobyteHD, size 20.69 MB, duration 4.70 sec {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 09:07:58 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Image download 20.69 MB at 4.40 MB/s
Jul 09 09:07:58 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbc334d-c87a-42d1-8096-5305ffd35fee]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:07:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_30g48db3devstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:58 devstack sudo[95104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_30g48db3devstack@QuobyteHD
Jul 09 09:07:58 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:58 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0" returned: 0 in 0.836s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:58 devstack sudo[95110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e 1G
Jul 09 09:07:58 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:59 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_30g48db3devstack@QuobyteHD" returned: 0 in 0.759s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:59 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Temporary image c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7 is fetched for user a4067b5a32714844b9d8f1e716f9e131. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 09:07:59 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[432b6aa5-5d87-4921-b3db-d1c759f872e7]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:07:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_30g48db3devstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:59 devstack sudo[95115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_30g48db3devstack@QuobyteHD
Jul 09 09:07:59 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:07:59 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root
Jul 09 09:07:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e 1G" returned: 0 in 0.943s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:07:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:07:59 devstack sudo[95120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e
Jul 09 09:07:59 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:00 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_30g48db3devstack@QuobyteHD" returned: 0 in 0.814s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:08:00 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e" returned: 0 in 0.713s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:00 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e is being set with open permissions: ugo+rw
Jul 09 09:08:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:00 devstack sudo[95128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e
Jul 09 09:08:00 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:00 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e" returned: 0 in 0.671s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:01 devstack sudo[95131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.info
Jul 09 09:08:01 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:01 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.info" returned: 0 in 0.649s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:01 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.info is being set with open permissions: ugo+rw
Jul 09 09:08:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:01 devstack sudo[95158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.info
Jul 09 09:08:01 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:02 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.info" returned: 0 in 0.702s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.621s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:08:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.359s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:08:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1140545165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f16e03b-694c-4d39-ab4f-a902515975d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5073945580d4493bc26e16f05741abf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:07:53Z,use_quota=True,user_id='a4067b5a32714844b9d8f1e716f9e131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76c98afd-a0d3-4168-a855-d62c8d8b5ded),volume_type_id=76c98afd-a0d3-4168-a855-d62c8d8b5ded)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:08:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Creating volume 9f16e03b-694c-4d39-ab4f-a902515975d1 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:08:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:08:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:08:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:08:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:08:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:08:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:08:02 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:08:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:02 devstack sudo[95162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 1073741824
Jul 09 09:08:02 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:02 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-ad1bb858-6fbf-4f44-aeed-741cec3bb6eb tempest-SnapshotMetadataTestJSON-739678972 None] Create snapshot completed successfully
Jul 09 09:08:03 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 1073741824" returned: 0 in 1.133s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:03 devstack sudo[95186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1
Jul 09 09:08:03 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Acquiring lock "cinder-2c07807d-3482-4750-9f3d-10e52e48218e-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Lock "cinder-2c07807d-3482-4750-9f3d-10e52e48218e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Acquiring lock "cinder-quobyte-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Lock "cinder-quobyte-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Acquiring lock "cinder-quobyte-2c07807d-3482-4750-9f3d-10e52e48218e" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Lock "cinder-quobyte-2c07807d-3482-4750-9f3d-10e52e48218e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Deleting offline snapshot 2c07807d-3482-4750-9f3d-10e52e48218e of volume 30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] snapshot_file for this snap is: volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4577e205-ccb0-4225-a457-5ab372927be7]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:04 devstack sudo[95189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e
Jul 09 09:08:04 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:04 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1" returned: 0 in 0.745s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Attempting download of c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7 ((None, [{'url': 'file:///opt/stack/data/glance/images/c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7', 'metadata': {}}])) to volume 9f16e03b-694c-4d39-ab4f-a902515975d1. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6671b40d-0b30-48ba-91b5-d649c74b4c2f]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_4v0uc7z2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:04 devstack sudo[95192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_4v0uc7z2
Jul 09 09:08:04 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:05 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e" returned: 0 in 0.887s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:08:05 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b913e1c-6bc6-49ce-8ada-c70ae91bed97]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:05 devstack sudo[95217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0
Jul 09 09:08:05 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:05 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_4v0uc7z2" returned: 0 in 0.912s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_4v0uc7z2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:05 devstack sudo[95233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_4v0uc7z2
Jul 09 09:08:05 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:06 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0" returned: 0 in 0.961s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:06 devstack sudo[95242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e
Jul 09 09:08:06 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:06 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_4v0uc7z2" returned: 1 in 1.006s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_4v0uc7z2' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:08:06 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a5e35c-9f9f-4e02-addc-a79cf8ffafbe]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_30g48db3devstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:06 devstack sudo[95253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_30g48db3devstack@QuobyteHD
Jul 09 09:08:06 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:07 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e" returned: 0 in 1.490s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:07 devstack sudo[95311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e
Jul 09 09:08:07 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:08 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_30g48db3devstack@QuobyteHD" returned: 0 in 1.877s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:08 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7 was qcow2, converting to raw {{(pid=87009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 09:08:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_30g48db3devstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:08 devstack sudo[95328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_30g48db3devstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1
Jul 09 09:08:08 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:08 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0.2c07807d-3482-4750-9f3d-10e52e48218e" returned: 0 in 1.250s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Lock "cinder-quobyte-2c07807d-3482-4750-9f3d-10e52e48218e" released by "_delete_snapshot" :: held 4.705s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Lock "cinder-quobyte-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0" released by "delete_snapshot" :: held 4.733s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:08 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Created reservations ['aaef7fd3-00db-4695-a80b-9c4ad06aed29', '5ab993fc-f0ad-42b6-a4bb-b227bcb42af1', '316c64fc-1417-4b53-8d07-73c9285dcd68', '820db89f-f15d-417d-af13-d061317f3089'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:08:09 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Delete snapshot completed successfully.
Jul 09 09:08:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-77ce953f-0fd1-45e3-ad99-fdaf1d4525e2 tempest-SnapshotMetadataTestJSON-739678972 None] Lock "cinder-2c07807d-3482-4750-9f3d-10e52e48218e-delete_snapshot" released by "delete_snapshot" :: held 4.959s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Acquiring lock "cinder-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Lock "cinder-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Acquiring lock "cinder-quobyte-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Lock "cinder-quobyte-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:10 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7e4175-12cd-4037-bf71-586479067b89]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:10 devstack sudo[95342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0
Jul 09 09:08:10 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:11 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0" returned: 0 in 1.243s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:11 devstack sudo[95348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0
Jul 09 09:08:11 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:11 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_30g48db3devstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1" returned: 0 in 3.036s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:11 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7_30g48db3devstack@QuobyteHD, size 112.00 MB, duration 3.04 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:08:11 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Converted 112.00 MB image at 36.87 MB/s
Jul 09 09:08:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:11 devstack sudo[95350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 1G
Jul 09 09:08:11 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:12 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0" returned: 0 in 0.845s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:12 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 1G" returned: 0 in 0.789s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Lock "cinder-quobyte-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0" released by "delete_volume" :: held 2.263s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:12 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92adc0f-f2af-4528-b798-0a7e3e717a4b]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:12 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Created reservations ['e549981e-8cd2-4c57-87b4-a1626912d821', '6b73c38d-1152-4e84-ac77-adb7a4745728', '2c8ccd6b-7298-45f7-8f9b-055ad7c5ca79', 'b6930080-0f8c-4423-9628-3498a5a3c3d7'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:08:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:08:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:08:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:08:12 devstack sudo[95356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1
Jul 09 09:08:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:08:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:08:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:12 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:12 devstack sudo[95358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:08:12 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:13 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1" returned: 0 in 0.966s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:13 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.818s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:13 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:08:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Deleted volume successfully.
Jul 09 09:08:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2bbd4893-d5db-4283-8eb7-1cad9b4aafab tempest-SnapshotMetadataTestJSON-739678972 None] Lock "cinder-30ed35d9-acce-4fc7-bea8-5c2e51b28dd0-delete_volume" released by "delete_volume" :: held 3.448s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:13 devstack sudo[95363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1
Jul 09 09:08:13 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:14 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1" returned: 1 in 0.846s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:08:14 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Downloaded image c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7 ((None, [{'url': 'file:///opt/stack/data/glance/images/c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7', 'metadata': {}}])) to volume 9f16e03b-694c-4d39-ab4f-a902515975d1 successfully. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 09:08:14 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Temporary image c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7 for user a4067b5a32714844b9d8f1e716f9e131 is deleted. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 09:08:14 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Marking volume 9f16e03b-694c-4d39-ab4f-a902515975d1 as bootable. {{(pid=87009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 09:08:14 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Copying metadata from image c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7 to 9f16e03b-694c-4d39-ab4f-a902515975d1. {{(pid=87009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 09:08:14 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Creating volume glance metadata for volume 9f16e03b-694c-4d39-ab4f-a902515975d1 backed by image c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7 with: {'image_id': 'c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7', 'image_name': 'tempest-scenario-img--990731123', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 09:08:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e8e612-e5c9-4be8-aff2-556e28806845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f16e03b-694c-4d39-ab4f-a902515975d1', 'volume_size': 1, 'image_id': 'c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--990731123', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5073945580d4493bc26e16f05741abf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7', 'created_at': datetime.datetime(2026, 7, 9, 7, 7, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 7, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4fc5416-b2d6-4d1e-8d51-3fdc0e628fe7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc5903cf860>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:08:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa895d17-bd35-4289-bd07-0d3bb2119dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:08:14 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Volume volume-9f16e03b-694c-4d39-ab4f-a902515975d1 (9f16e03b-694c-4d39-ab4f-a902515975d1): created successfully
Jul 09 09:08:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa895d17-bd35-4289-bd07-0d3bb2119dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:08:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Flow 'volume_create_manager' (46481195-1b9b-4480-9adb-c1efb83a9d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:08:14 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6493ed03-6d11-433f-bb7d-52b3943d9140 tempest-TestInstancesWithCinderVolumes-1780519803 None] Created volume successfully.
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Flow 'volume_create_manager' (ee63961a-7ad7-4271-bf5d-8ef84930ccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6449922d-c688-4b14-8fa3-cd12ee4c6a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6449922d-c688-4b14-8fa3-cd12ee4c6a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-575757841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12afb6d6-9825-48c1-8d2d-9d8c2d61b166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d132e691e884e3fb40069cb219bd297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:08:18Z,use_quota=True,user_id='f9cdca19247046fd9f245f962228a275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2ba351-0e35-4c1f-bc78-3b4cfb2bf95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2ba351-0e35-4c1f-bc78-3b4cfb2bf95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4244dc13-89e9-4139-a8de-72dd7c925d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4244dc13-89e9-4139-a8de-72dd7c925d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12afb6d6-9825-48c1-8d2d-9d8c2d61b166', 'volume_name': 'volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e5784d-2203-401a-9859-c9454604ed3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e5784d-2203-401a-9859-c9454604ed3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0fe861-05a6-4d60-8185-ea014ed4ee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:08:18 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Volume 12afb6d6-9825-48c1-8d2d-9d8c2d61b166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166', 'volume_size': 1}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-575757841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12afb6d6-9825-48c1-8d2d-9d8c2d61b166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d132e691e884e3fb40069cb219bd297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:08:18Z,use_quota=True,user_id='f9cdca19247046fd9f245f962228a275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Creating volume 12afb6d6-9825-48c1-8d2d-9d8c2d61b166 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:08:18 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:08:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:18 devstack sudo[95406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166 1073741824
Jul 09 09:08:18 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:19 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166 1073741824" returned: 0 in 1.042s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:19 devstack sudo[95415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166
Jul 09 09:08:19 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:20 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166" returned: 0 in 0.754s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:08:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:08:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0fe861-05a6-4d60-8185-ea014ed4ee02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:08:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17addefe-d57c-479e-b761-a84c58ec96cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:08:20 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Volume volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166 (12afb6d6-9825-48c1-8d2d-9d8c2d61b166): created successfully
Jul 09 09:08:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17addefe-d57c-479e-b761-a84c58ec96cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:08:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Flow 'volume_create_manager' (ee63961a-7ad7-4271-bf5d-8ef84930ccdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:08:20 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5bd24a32-61ea-4b47-8348-14bf8282afc5 tempest-AbsoluteLimitsTests-1009075061 None] Created volume successfully.
Jul 09 09:08:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Acquiring lock "cinder-12afb6d6-9825-48c1-8d2d-9d8c2d61b166-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Lock "cinder-12afb6d6-9825-48c1-8d2d-9d8c2d61b166-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Acquiring lock "cinder-quobyte-12afb6d6-9825-48c1-8d2d-9d8c2d61b166" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Lock "cinder-quobyte-12afb6d6-9825-48c1-8d2d-9d8c2d61b166" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:21 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b8c99d-66f7-45ed-890f-c23441cd0577]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:21 devstack sudo[95421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166
Jul 09 09:08:21 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:22 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166" returned: 0 in 0.851s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:22 devstack sudo[95428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166
Jul 09 09:08:22 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:23 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-12afb6d6-9825-48c1-8d2d-9d8c2d61b166" returned: 0 in 1.007s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Lock "cinder-quobyte-12afb6d6-9825-48c1-8d2d-9d8c2d61b166" released by "delete_volume" :: held 1.907s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:23 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Created reservations ['71cda40f-f285-405c-bc04-88595592f842', '30dafee1-22c7-493a-9c44-a4bdc6bcdfe8', 'fe0d677f-67e1-4679-9812-412fe4819dfd', '219c722f-7ea9-440e-89cb-16204e1438c9'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:08:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:08:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:08:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:08:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:08:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:08:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-46993e9c-88cc-4de9-b20c-1506d3042a51 req-c4ae88e0-2000-4323-a066-be949b17c6d7 tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:08:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-46993e9c-88cc-4de9-b20c-1506d3042a51 req-c4ae88e0-2000-4323-a066-be949b17c6d7 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:08:23 devstack sudo[95452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:08:23 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:23 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d29e00a-1973-4a94-b775-92494af393fe]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-46993e9c-88cc-4de9-b20c-1506d3042a51 req-c4ae88e0-2000-4323-a066-be949b17c6d7 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:24 devstack sudo[95454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1
Jul 09 09:08:24 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:24 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.847s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:24 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:08:24 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Deleted volume successfully.
Jul 09 09:08:24 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-24f30061-eb1a-494d-8e9e-7b9199c7a0b2 tempest-AbsoluteLimitsTests-1009075061 None] Lock "cinder-12afb6d6-9825-48c1-8d2d-9d8c2d61b166-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:24 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-46993e9c-88cc-4de9-b20c-1506d3042a51 req-c4ae88e0-2000-4323-a066-be949b17c6d7 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1" returned: 0 in 0.937s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-46993e9c-88cc-4de9-b20c-1506d3042a51 req-c4ae88e0-2000-4323-a066-be949b17c6d7 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:24 devstack sudo[95460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1
Jul 09 09:08:24 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:25 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-46993e9c-88cc-4de9-b20c-1506d3042a51 req-c4ae88e0-2000-4323-a066-be949b17c6d7 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1" returned: 1 in 0.899s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-46993e9c-88cc-4de9-b20c-1506d3042a51 req-c4ae88e0-2000-4323-a066-be949b17c6d7 tempest-TestInstancesWithCinderVolumes-1780519803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:08:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-46993e9c-88cc-4de9-b20c-1506d3042a51 req-c4ae88e0-2000-4323-a066-be949b17c6d7 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.881s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:08:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-46993e9c-88cc-4de9-b20c-1506d3042a51 req-c4ae88e0-2000-4323-a066-be949b17c6d7 tempest-TestInstancesWithCinderVolumes-1780519803 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-9f16e03b-694c-4d39-ab4f-a902515975d1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38de403c-01f2-432b-988e-5756f18c74b1', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:08:25 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-46993e9c-88cc-4de9-b20c-1506d3042a51 req-c4ae88e0-2000-4323-a066-be949b17c6d7 tempest-TestInstancesWithCinderVolumes-1780519803 None] attachment_update completed successfully.
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=60,cinder:UPDATE=64,cinder:DELETE=10,cinder:INSERT=20 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Flow 'volume_create_manager' (13558270-59a7-420b-b847-3d7ec33bed4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615e36ef-a233-4d2d-ba48-a5431fec3191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615e36ef-a233-4d2d-ba48-a5431fec3191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1410009158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f5c99f-8670-4262-9137-429d1661c810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d58f2ac5164043be0ae45ad1e5e127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:08:28Z,use_quota=True,user_id='cc4501ed185d4a6b8c6e42f1968e35d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae41c4f-fd04-4908-9de9-9e448fea712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae41c4f-fd04-4908-9de9-9e448fea712b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f27627-eb94-45d7-975f-7db072053f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f27627-eb94-45d7-975f-7db072053f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7f5c99f-8670-4262-9137-429d1661c810', 'volume_name': 'volume-e7f5c99f-8670-4262-9137-429d1661c810', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4abfb29-c06b-446d-a7a8-ab4a79b6905f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4abfb29-c06b-446d-a7a8-ab4a79b6905f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397e8e54-504e-4219-a649-b72584934e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:08:28 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Volume e7f5c99f-8670-4262-9137-429d1661c810: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7f5c99f-8670-4262-9137-429d1661c810', 'volume_size': 1}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1410009158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f5c99f-8670-4262-9137-429d1661c810,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d58f2ac5164043be0ae45ad1e5e127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:08:28Z,use_quota=True,user_id='cc4501ed185d4a6b8c6e42f1968e35d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Creating volume e7f5c99f-8670-4262-9137-429d1661c810 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:08:28 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:08:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:28 devstack sudo[95470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810 1073741824
Jul 09 09:08:28 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:29 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810 1073741824" returned: 0 in 1.231s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:29 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=68,cinder:INSERT=14,cinder:UPDATE=60,cinder:DELETE=2 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:08:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:29 devstack sudo[95518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810
Jul 09 09:08:29 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:30 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810" returned: 0 in 1.095s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] <== create_volume: return (2402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:08:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.409s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:08:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397e8e54-504e-4219-a649-b72584934e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f5c99f-8670-4262-9137-429d1661c810', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:08:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b334e1-f096-4f9b-90eb-285276bf7245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:08:31 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Volume volume-e7f5c99f-8670-4262-9137-429d1661c810 (e7f5c99f-8670-4262-9137-429d1661c810): created successfully
Jul 09 09:08:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b334e1-f096-4f9b-90eb-285276bf7245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:08:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Flow 'volume_create_manager' (13558270-59a7-420b-b847-3d7ec33bed4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:08:31 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7f17acb8-6254-491a-9723-11cd6e9ed3fb tempest-VolumesDeleteCascade-1064808161 None] Created volume successfully.
Jul 09 09:08:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:08:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:08:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] Creating offline snapshot 3e24cf4b-de95-41cf-84a3-d73508e8ab53 of volume e7f5c99f-8670-4262-9137-429d1661c810 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:08:32 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed70ed5-0362-4a2e-a0f1-dcd88fa08054]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:32 devstack sudo[95551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810
Jul 09 09:08:32 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:33 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810" returned: 0 in 1.121s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:33 devstack sudo[95567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 1G
Jul 09 09:08:33 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:34 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 1G" returned: 0 in 1.034s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7f5c99f-8670-4262-9137-429d1661c810 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:34 devstack sudo[95573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7f5c99f-8670-4262-9137-429d1661c810 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53
Jul 09 09:08:34 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:35 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-b235d2ec-48fd-423d-b4a1-eafb3458d047 req-d88facfc-6ba6-4ee7-ad52-57f1cb1954f5 tempest-AttachVolumeTestJSON-2089683209 None] Terminate volume connection completed successfully.
Jul 09 09:08:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-b235d2ec-48fd-423d-b4a1-eafb3458d047 req-d88facfc-6ba6-4ee7-ad52-57f1cb1954f5 tempest-AttachVolumeTestJSON-2089683209 None] Deleting attachment 5cb8df72-cf76-4293-8f9a-78ae7b3cc149. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:08:35 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-58b187fd-6a29-487e-8556-652cb95f4a85 req-54991091-d8fb-4e18-9a45-d618830e0448 tempest-TestMinimumBasicScenario-1049986500 None] Terminate volume connection completed successfully.
Jul 09 09:08:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-58b187fd-6a29-487e-8556-652cb95f4a85 req-54991091-d8fb-4e18-9a45-d618830e0448 tempest-TestMinimumBasicScenario-1049986500 None] Deleting attachment 725f0242-d9e7-4d58-bf0f-275bb22c905d. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:08:35 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7f5c99f-8670-4262-9137-429d1661c810 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53" returned: 0 in 1.021s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:35 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 is being set with open permissions: ugo+rw
Jul 09 09:08:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:35 devstack sudo[95580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53
Jul 09 09:08:35 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:36 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53" returned: 0 in 0.854s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:36 devstack sudo[95584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.info
Jul 09 09:08:36 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Acquiring lock "cinder-eed25e79-8d1f-406a-b44b-e9a45ab037a5-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Lock "cinder-eed25e79-8d1f-406a-b44b-e9a45ab037a5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Acquiring lock "cinder-quobyte-eed25e79-8d1f-406a-b44b-e9a45ab037a5" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Lock "cinder-quobyte-eed25e79-8d1f-406a-b44b-e9a45ab037a5" acquired by "delete_volume" :: waited 0.040s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:36 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b769bc5-cb56-4db3-83d4-2276bb77d37f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:37 devstack sudo[95589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5
Jul 09 09:08:37 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:37 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.info" returned: 0 in 1.388s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:37 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.info is being set with open permissions: ugo+rw
Jul 09 09:08:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:37 devstack sudo[95592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.info
Jul 09 09:08:37 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:38 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5" returned: 0 in 1.537s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:38 devstack sudo[95602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5
Jul 09 09:08:38 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:38 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.info" returned: 0 in 1.342s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.890s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:08:38 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-48b655f7-b53f-474c-8594-948ba94a6c8d tempest-VolumesDeleteCascade-1064808161 None] Create snapshot completed successfully
Jul 09 09:08:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:08:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:08:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] Creating offline snapshot f07710b3-6669-44d3-84a6-970f6a341ecd of volume e7f5c99f-8670-4262-9137-429d1661c810 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:08:39 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a954fb64-45d5-4779-ace4-532ed36c018e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:39 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-eed25e79-8d1f-406a-b44b-e9a45ab037a5" returned: 0 in 1.003s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Lock "cinder-quobyte-eed25e79-8d1f-406a-b44b-e9a45ab037a5" released by "delete_volume" :: held 2.639s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:39 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Created reservations ['b2cd4c28-c6dc-4b87-b4dd-74aaf0e8567a', 'a8223749-c196-4e27-8792-c9d6e4b4593d', 'be0b1834-9816-4899-893c-fa13b8e4bec6', '7617a167-9615-4dcc-8583-8ec3de5bfdd2'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:08:39 devstack sudo[95607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53
Jul 09 09:08:39 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:08:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:08:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:08:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:08:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:08:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:39 devstack sudo[95609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:08:39 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:40 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53" returned: 0 in 1.285s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7f5c99f-8670-4262-9137-429d1661c810(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:08:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:40 devstack sudo[95615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd 1G
Jul 09 09:08:40 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:41 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.441s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:41 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:08:41 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Deleted volume successfully.
Jul 09 09:08:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dc31ab96-9241-44bb-bca0-d427bd0f684a tempest-TestMinimumBasicScenario-1049986500 None] Lock "cinder-eed25e79-8d1f-406a-b44b-e9a45ab037a5-delete_volume" released by "delete_volume" :: held 4.602s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:42 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd 1G" returned: 0 in 1.333s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:42 devstack sudo[95629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd
Jul 09 09:08:42 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:43 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd" returned: 0 in 1.064s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:43 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd is being set with open permissions: ugo+rw
Jul 09 09:08:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:43 devstack sudo[95649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd
Jul 09 09:08:43 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:44 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd" returned: 0 in 1.024s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.838s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:08:44 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3b1c174e-3f1d-405d-acf8-356d3da8b92c tempest-VolumesDeleteCascade-1064808161 None] Create snapshot completed successfully
Jul 09 09:08:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-e7f5c99f-8670-4262-9137-429d1661c810-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-e7f5c99f-8670-4262-9137-429d1661c810-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Performing cascade delete. {{(pid=87009) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 09 09:08:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-3e24cf4b-de95-41cf-84a3-d73508e8ab53-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-3e24cf4b-de95-41cf-84a3-d73508e8ab53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-quobyte-e7f5c99f-8670-4262-9137-429d1661c810" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-e7f5c99f-8670-4262-9137-429d1661c810" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-quobyte-3e24cf4b-de95-41cf-84a3-d73508e8ab53" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-3e24cf4b-de95-41cf-84a3-d73508e8ab53" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Deleting offline snapshot 3e24cf4b-de95-41cf-84a3-d73508e8ab53 of volume e7f5c99f-8670-4262-9137-429d1661c810 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:08:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] snapshot_file for this snap is: volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:08:45 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a62456-e7d2-4a81-af7f-3b06f9166fc1]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:45 devstack sudo[95657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53
Jul 09 09:08:45 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53" returned: 0 in 0.782s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:45 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7f5c99f-8670-4262-9137-429d1661c810(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:08:45 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[65461ffe-ac34-4212-b31e-7710b059266e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:46 devstack sudo[95671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810
Jul 09 09:08:46 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:47 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810" returned: 0 in 1.146s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:47 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea114d46-9e27-47f1-babc-b3b7300fd3ba]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:47 devstack sudo[95728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd
Jul 09 09:08:47 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:48 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd" returned: 0 in 0.904s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7f5c99f-8670-4262-9137-429d1661c810(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:08:48 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[850897fc-2c23-4f3e-83f4-6913d5423395]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:48 devstack sudo[95757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53
Jul 09 09:08:48 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:49 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53" returned: 0 in 1.086s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7f5c99f-8670-4262-9137-429d1661c810(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:08:49 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae31aff2-9412-4c4b-8b63-b991c8931543]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:49 devstack sudo[95796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810
Jul 09 09:08:49 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:50 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810" returned: 0 in 1.294s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:50 devstack sudo[95840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53
Jul 09 09:08:50 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:51 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53" returned: 0 in 0.914s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:51 devstack sudo[95848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53
Jul 09 09:08:51 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:52 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.3e24cf4b-de95-41cf-84a3-d73508e8ab53" returned: 0 in 0.769s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7f5c99f-8670-4262-9137-429d1661c810 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd -F qcow2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:52 devstack sudo[95851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7f5c99f-8670-4262-9137-429d1661c810 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd -F qcow2
Jul 09 09:08:52 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:53 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7f5c99f-8670-4262-9137-429d1661c810 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd -F qcow2" returned: 0 in 1.059s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-3e24cf4b-de95-41cf-84a3-d73508e8ab53" released by "_delete_snapshot" :: held 8.300s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-e7f5c99f-8670-4262-9137-429d1661c810" released by "delete_snapshot" :: held 8.342s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Created reservations ['b9efa764-2014-4e3e-b94e-9e826b778cd8', 'b92628da-c61c-4bf9-9f66-8e835988ff0a', '9759e07d-32cb-4b76-a340-0ad2f551b5d5', 'ff0a809f-9feb-4484-9cb4-dd89258084b7'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:08:53 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Delete snapshot completed successfully.
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-3e24cf4b-de95-41cf-84a3-d73508e8ab53-delete_snapshot" released by "delete_snapshot" :: held 8.677s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-f07710b3-6669-44d3-84a6-970f6a341ecd-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-f07710b3-6669-44d3-84a6-970f6a341ecd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-quobyte-e7f5c99f-8670-4262-9137-429d1661c810" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-e7f5c99f-8670-4262-9137-429d1661c810" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-quobyte-f07710b3-6669-44d3-84a6-970f6a341ecd" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-f07710b3-6669-44d3-84a6-970f6a341ecd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Deleting offline snapshot f07710b3-6669-44d3-84a6-970f6a341ecd of volume e7f5c99f-8670-4262-9137-429d1661c810 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] snapshot_file for this snap is: volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ab5b8b-5e6d-497f-9c11-142df48fab72]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:53 devstack sudo[95857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd
Jul 09 09:08:53 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:08:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:08:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:08:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:08:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:08:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:08:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:54 devstack sudo[95859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:08:54 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:55 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd" returned: 0 in 1.396s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7f5c99f-8670-4262-9137-429d1661c810(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:08:55 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[85309f78-8ff4-4da2-bc8a-f7a1ae38bc18]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:55 devstack sudo[95872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810
Jul 09 09:08:55 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:55 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.284s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:08:55 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:08:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:08:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:08:56 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810" returned: 0 in 1.245s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:56 devstack sudo[95883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd
Jul 09 09:08:56 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:57 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd" returned: 0 in 1.115s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:57 devstack sudo[95894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd
Jul 09 09:08:57 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:58 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810.f07710b3-6669-44d3-84a6-970f6a341ecd" returned: 0 in 0.741s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-f07710b3-6669-44d3-84a6-970f6a341ecd" released by "_delete_snapshot" :: held 4.653s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-e7f5c99f-8670-4262-9137-429d1661c810" released by "delete_snapshot" :: held 4.685s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:58 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Created reservations ['fd39f0d1-9fb5-4892-89ec-f53d941dd052', 'ee4f4c18-fd70-4bee-9e11-ea1f635c1ca7', '573dae2b-4280-4a3b-859c-27930da3781d', '6fd0c033-de1b-4e27-9ce7-7550aafae9f7'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:08:58 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Delete snapshot completed successfully.
Jul 09 09:08:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-f07710b3-6669-44d3-84a6-970f6a341ecd-delete_snapshot" released by "delete_snapshot" :: held 4.901s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:08:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Snapshots deleted, issuing volume delete {{(pid=87009) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 09 09:08:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-quobyte-e7f5c99f-8670-4262-9137-429d1661c810" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:08:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-e7f5c99f-8670-4262-9137-429d1661c810" acquired by "delete_volume" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:08:58 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3e492a-d8a4-4196-821f-379bd994d91f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:08:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:58 devstack sudo[95897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810
Jul 09 09:08:58 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:08:59 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root
Jul 09 09:08:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810" returned: 0 in 1.175s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:08:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:08:59 devstack sudo[95908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810
Jul 09 09:08:59 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-f83bdb38-20ab-4451-b0f9-ea14f16d1a90 req-761b53a2-ab88-4db3-b6f9-9e14c5c473a1 tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-f83bdb38-20ab-4451-b0f9-ea14f16d1a90 req-761b53a2-ab88-4db3-b6f9-9e14c5c473a1 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:00 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a37eb1-3250-4de3-8eba-b6d9cf378cbd]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-f83bdb38-20ab-4451-b0f9-ea14f16d1a90 req-761b53a2-ab88-4db3-b6f9-9e14c5c473a1 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:00 devstack sudo[95914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6
Jul 09 09:09:00 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:00 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e7f5c99f-8670-4262-9137-429d1661c810" returned: 0 in 0.955s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-e7f5c99f-8670-4262-9137-429d1661c810" released by "delete_volume" :: held 2.193s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:00 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Created reservations ['ef735bd5-61de-4400-9b03-8c41d53ad812', '4e6427da-6c18-4dd8-b21f-df9efb75ba64', '95dc7ce8-98cb-4842-932b-c339d6a19088', 'f4826324-9131-499a-8899-6c12a3442d31'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:09:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:00 devstack sudo[95918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:09:00 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:01 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-f83bdb38-20ab-4451-b0f9-ea14f16d1a90 req-761b53a2-ab88-4db3-b6f9-9e14c5c473a1 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6" returned: 0 in 1.166s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-f83bdb38-20ab-4451-b0f9-ea14f16d1a90 req-761b53a2-ab88-4db3-b6f9-9e14c5c473a1 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.202s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:01 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-f83bdb38-20ab-4451-b0f9-ea14f16d1a90 req-761b53a2-ab88-4db3-b6f9-9e14c5c473a1 tempest-TestInstancesWithCinderVolumes-1780519803 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-85201daa-3dfb-4796-af90-132781538ab6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e15193f5-e820-4f73-89fe-ca799ffae601', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:09:01 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-f83bdb38-20ab-4451-b0f9-ea14f16d1a90 req-761b53a2-ab88-4db3-b6f9-9e14c5c473a1 tempest-TestInstancesWithCinderVolumes-1780519803 None] attachment_update completed successfully.
Jul 09 09:09:01 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.980s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:01 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:09:01 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Deleted volume successfully.
Jul 09 09:09:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7270e96b-d4fb-4f50-bc49-8e081aaff31a tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-e7f5c99f-8670-4262-9137-429d1661c810-delete_volume" released by "delete_volume" :: held 17.082s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Flow 'volume_create_manager' (0f0536f6-968a-496c-bc3f-baeec482c87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803e88b2-4450-41c4-b012-c9c43b67ad80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803e88b2-4450-41c4-b012-c9c43b67ad80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1246220526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d58f2ac5164043be0ae45ad1e5e127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:09:03Z,use_quota=True,user_id='cc4501ed185d4a6b8c6e42f1968e35d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6661be26-3c3a-4df4-aef7-7634722e7f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6661be26-3c3a-4df4-aef7-7634722e7f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b162f8-a1de-4322-914e-3ac77a1e1a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b162f8-a1de-4322-914e-3ac77a1e1a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae', 'volume_name': 'volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43e5f4d-9231-46f5-9cf5-0c01c1e184d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43e5f4d-9231-46f5-9cf5-0c01c1e184d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3abe5c0-3b00-4173-9061-2c2b23b8c884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:02 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Volume ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae', 'volume_size': 1}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1246220526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d58f2ac5164043be0ae45ad1e5e127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:09:03Z,use_quota=True,user_id='cc4501ed185d4a6b8c6e42f1968e35d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Creating volume ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:09:02 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:09:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:02 devstack sudo[95926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae 1073741824
Jul 09 09:09:02 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:03 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae 1073741824" returned: 0 in 0.933s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:03 devstack sudo[95933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae
Jul 09 09:09:03 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:04 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae" returned: 0 in 0.660s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:09:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:04 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3abe5c0-3b00-4173-9061-2c2b23b8c884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:04 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dac203f-ed47-4764-8f99-26e9645f376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:04 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Volume volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae (ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae): created successfully
Jul 09 09:09:04 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dac203f-ed47-4764-8f99-26e9645f376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:04 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Flow 'volume_create_manager' (0f0536f6-968a-496c-bc3f-baeec482c87d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:09:04 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b061ec22-1a7c-402e-a333-88cc7d54da11 tempest-VolumesDeleteCascade-1064808161 None] Created volume successfully.
Jul 09 09:09:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] Creating offline snapshot 267f18bb-146b-469a-80a4-e192e632fced of volume ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:09:04 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[35272bad-6247-4f9a-ae57-8a478bab7099]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:04 devstack sudo[95936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae
Jul 09 09:09:04 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:05 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae" returned: 0 in 0.896s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:05 devstack sudo[95941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced 1G
Jul 09 09:09:05 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:06 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced 1G" returned: 0 in 0.901s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:06 devstack sudo[95956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced
Jul 09 09:09:06 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:07 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced" returned: 0 in 0.757s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:07 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced is being set with open permissions: ugo+rw
Jul 09 09:09:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:07 devstack sudo[95961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced
Jul 09 09:09:07 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:07 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced" returned: 0 in 0.662s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:08 devstack sudo[95965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.info
Jul 09 09:09:08 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:08 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.info" returned: 0 in 0.821s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:08 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.info is being set with open permissions: ugo+rw
Jul 09 09:09:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:08 devstack sudo[95971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.info
Jul 09 09:09:08 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-7387a362-2705-4cab-acde-01d02b30d75d req-f2e0fa98-f040-411a-9041-66d039c74d92 tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:09 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.info" returned: 0 in 0.977s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.117s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-7387a362-2705-4cab-acde-01d02b30d75d req-f2e0fa98-f040-411a-9041-66d039c74d92 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.228s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:09 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb47d1d2-8e70-49c2-b574-3fb3edf5686c]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-7387a362-2705-4cab-acde-01d02b30d75d req-f2e0fa98-f040-411a-9041-66d039c74d92 tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:09 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-ce07824c-ec60-4ec5-bbfe-0c2d3e74692d tempest-VolumesDeleteCascade-1064808161 None] Create snapshot completed successfully
Jul 09 09:09:10 devstack sudo[95982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81
Jul 09 09:09:10 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:10 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-7387a362-2705-4cab-acde-01d02b30d75d req-f2e0fa98-f040-411a-9041-66d039c74d92 tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81" returned: 0 in 0.898s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-7387a362-2705-4cab-acde-01d02b30d75d req-f2e0fa98-f040-411a-9041-66d039c74d92 tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.941s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-7387a362-2705-4cab-acde-01d02b30d75d req-f2e0fa98-f040-411a-9041-66d039c74d92 tempest-TestInstancesWithCinderVolumes-1780519803 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef3fac32-206a-4633-bb83-7aeedb85f236', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:09:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-7387a362-2705-4cab-acde-01d02b30d75d req-f2e0fa98-f040-411a-9041-66d039c74d92 tempest-TestInstancesWithCinderVolumes-1780519803 None] attachment_update completed successfully.
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Flow 'volume_create_manager' (3feae7c9-5c4c-4c35-a582-471f9cc278da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16455d80-d725-42ce-a4cf-c7353acdf0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16455d80-d725-42ce-a4cf-c7353acdf0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-369958946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ad345c-2766-453f-a2a0-b045fe9e2274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7d58f2ac5164043be0ae45ad1e5e127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=267f18bb-146b-469a-80a4-e192e632fced,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:09:12Z,use_quota=True,user_id='cc4501ed185d4a6b8c6e42f1968e35d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c04bcf-a8f2-4736-937c-770a2cbef762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c04bcf-a8f2-4736-937c-770a2cbef762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b41503f-707a-410a-a5de-72e9f2d41356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b41503f-707a-410a-a5de-72e9f2d41356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8ad345c-2766-453f-a2a0-b045fe9e2274', 'volume_name': 'volume-b8ad345c-2766-453f-a2a0-b045fe9e2274', 'volume_size': 1, 'snapshot_id': '267f18bb-146b-469a-80a4-e192e632fced'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d993d81e-bdd9-419f-bc07-d853d9facdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d993d81e-bdd9-419f-bc07-d853d9facdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7d1506-4af4-4c6e-bfb6-36637053dc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:11 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Volume b8ad345c-2766-453f-a2a0-b045fe9e2274: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8ad345c-2766-453f-a2a0-b045fe9e2274', 'volume_size': 1, 'snapshot_id': '267f18bb-146b-469a-80a4-e192e632fced'}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-quobyte-267f18bb-146b-469a-80a4-e192e632fced-b8ad345c-2766-453f-a2a0-b045fe9e2274" by "_create_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-267f18bb-146b-469a-80a4-e192e632fced-b8ad345c-2766-453f-a2a0-b045fe9e2274" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Creating volume b8ad345c-2766-453f-a2a0-b045fe9e2274 from snapshot 267f18bb-146b-469a-80a4-e192e632fced {{(pid=87009) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-quobyte-b8ad345c-2766-453f-a2a0-b045fe9e2274" by "_copy_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-b8ad345c-2766-453f-a2a0-b045fe9e2274" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] snapshot: 267f18bb-146b-469a-80a4-e192e632fced, volume: b8ad345c-2766-453f-a2a0-b045fe9e2274,  {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff021b3-b96a-4e0c-b7c1-d3e727bcdd25]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:12 devstack sudo[95989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced
Jul 09 09:09:12 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:12 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced" returned: 0 in 0.809s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:09:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] will copy from snapshot at /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 09:09:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Creating direct copy from snapshot {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 09:09:12 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cd9836-92ac-426c-a21c-bdaddae46546]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:12 devstack sudo[95994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae
Jul 09 09:09:12 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:13 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae" returned: 0 in 0.905s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:13 devstack cinder-volume[87009]: DEBUG cinder.utils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Path /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274 not found in is_blk_device check {{(pid=87009) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 09:09:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:13 devstack sudo[96001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274
Jul 09 09:09:13 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:20 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274" returned: 0 in 7.157s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:20 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[59578a44-9c6e-43ee-a1b2-a40a411725fc]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:21 devstack sudo[96102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae
Jul 09 09:09:21 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:21 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=42,cinder:SELECT=41,cinder:DELETE=3,cinder:INSERT=11 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:09:21 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:21 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=38,cinder:SELECT=54,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:09:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae" returned: 0 in 1.026s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:21 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Image conversion details: src /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274 {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:09:21 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Converted 1024.00 MB image at 143.05 MB/s
Jul 09 09:09:21 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274 is being set with open permissions: ugo+rw
Jul 09 09:09:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:21 devstack sudo[96112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274
Jul 09 09:09:21 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:22 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274" returned: 0 in 0.733s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-b8ad345c-2766-453f-a2a0-b045fe9e2274" released by "_copy_volume_from_snapshot" :: held 10.756s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-267f18bb-146b-469a-80a4-e192e632fced-b8ad345c-2766-453f-a2a0-b045fe9e2274" released by "_create_volume_from_snapshot" :: held 10.795s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.816s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7d1506-4af4-4c6e-bfb6-36637053dc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8ad345c-2766-453f-a2a0-b045fe9e2274', 'volume_size': 1, 'snapshot_id': '267f18bb-146b-469a-80a4-e192e632fced'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd3ae67-2571-457d-8ff1-d15fa9b2041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:22 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Volume volume-b8ad345c-2766-453f-a2a0-b045fe9e2274 (b8ad345c-2766-453f-a2a0-b045fe9e2274): created successfully
Jul 09 09:09:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd3ae67-2571-457d-8ff1-d15fa9b2041f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Flow 'volume_create_manager' (3feae7c9-5c4c-4c35-a582-471f9cc278da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:09:22 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6924d582-1c16-434f-bf70-a4fa824a5c6b tempest-VolumesDeleteCascade-1064808161 None] Created volume successfully.
Jul 09 09:09:22 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-ade725ff-18e3-472f-8c7c-fec7eb2454be req-526982c9-f591-4ca7-9a83-5ec36bdb13a0 tempest-TestInstancesWithCinderVolumes-1780519803 None] Terminate volume connection completed successfully.
Jul 09 09:09:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-ade725ff-18e3-472f-8c7c-fec7eb2454be req-526982c9-f591-4ca7-9a83-5ec36bdb13a0 tempest-TestInstancesWithCinderVolumes-1780519803 None] Deleting attachment e15193f5-e820-4f73-89fe-ca799ffae601. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:09:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Performing cascade delete. {{(pid=87009) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 09 09:09:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-267f18bb-146b-469a-80a4-e192e632fced-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-267f18bb-146b-469a-80a4-e192e632fced-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-quobyte-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-quobyte-267f18bb-146b-469a-80a4-e192e632fced" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-267f18bb-146b-469a-80a4-e192e632fced" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Deleting offline snapshot 267f18bb-146b-469a-80a4-e192e632fced of volume ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:09:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] snapshot_file for this snap is: volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:09:23 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec98141-fd6d-44a0-a079-0e6f9d293084]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:23 devstack sudo[96120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced
Jul 09 09:09:23 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:24 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced" returned: 0 in 1.090s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:09:24 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cefc08-ccb3-40ff-b3b3-4ae3d4e180d7]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:24 devstack sudo[96125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae
Jul 09 09:09:24 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:24 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "cinder-85201daa-3dfb-4796-af90-132781538ab6-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:24 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "cinder-85201daa-3dfb-4796-af90-132781538ab6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "cinder-quobyte-85201daa-3dfb-4796-af90-132781538ab6" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "cinder-quobyte-85201daa-3dfb-4796-af90-132781538ab6" acquired by "delete_volume" :: waited 0.034s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:25 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a3a855-a924-4490-83a8-0f63f7088da2]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:25 devstack sudo[96131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6
Jul 09 09:09:25 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:25 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae" returned: 0 in 1.087s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:25 devstack sudo[96136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced
Jul 09 09:09:25 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:26 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6" returned: 0 in 1.240s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:26 devstack sudo[96143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6
Jul 09 09:09:26 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:26 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced" returned: 0 in 1.231s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:26 devstack sudo[96147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced
Jul 09 09:09:26 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:27 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-85201daa-3dfb-4796-af90-132781538ab6" returned: 0 in 1.248s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "cinder-quobyte-85201daa-3dfb-4796-af90-132781538ab6" released by "delete_volume" :: held 2.588s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:27 devstack cinder-volume[87009]: WARNING cinder.quota [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1956249028-620169873 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1956249028-620169873, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:09:27 devstack cinder-volume[87009]: WARNING cinder.quota [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1956249028-620169873 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1956249028-620169873, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:09:27 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Created reservations ['fdeddca9-fab0-4ec2-b737-4bb0d761b8a1', '09b55809-994e-453e-a2f0-7fd8d9fb88b8', '4d2435b0-0500-4964-8a04-527af0a61162', 'b39bb737-3bbb-496f-9989-089d616206a0'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:09:27 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae.267f18bb-146b-469a-80a4-e192e632fced" returned: 0 in 0.998s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-267f18bb-146b-469a-80a4-e192e632fced" released by "_delete_snapshot" :: held 4.535s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae" released by "delete_snapshot" :: held 4.565s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:27 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Created reservations ['4928bd06-fd9b-4bd3-b639-16a33478503c', '1c379c88-01e4-450e-b2ca-f8d25c521840', 'fef3381b-56fa-4b03-95e9-4fcf9022e30f', '677d72de-14f4-4b48-833c-cfb7cadc21cc'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:09:27 devstack sudo[96155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:09:27 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:28 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Delete snapshot completed successfully.
Jul 09 09:09:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-267f18bb-146b-469a-80a4-e192e632fced-delete_snapshot" released by "delete_snapshot" :: held 4.849s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Snapshots deleted, issuing volume delete {{(pid=87009) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 09 09:09:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-quobyte-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae" acquired by "delete_volume" :: waited 0.033s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:28 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[70576102-3fe4-4eb5-bc84-f69049b05710]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:28 devstack sudo[96161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae
Jul 09 09:09:28 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:28 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.001s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:28 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:09:28 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Deleted volume successfully.
Jul 09 09:09:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d12e97bd-e537-46ef-b546-99e060848b0b tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "cinder-85201daa-3dfb-4796-af90-132781538ab6-delete_volume" released by "delete_volume" :: held 4.017s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:29 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae" returned: 0 in 1.184s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:29 devstack sudo[96181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae
Jul 09 09:09:29 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:30 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae" returned: 0 in 0.682s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:30 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae" released by "delete_volume" :: held 1.979s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:30 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Created reservations ['9e2ea400-094e-4a7f-bcc5-2288d291810b', '08a0071e-902f-4563-be15-da87006402a4', '1f4f1070-d49f-4da8-b22e-998ef68e897d', '76ca082f-1bfe-4fff-b447-355b7de4bda2'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:09:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:30 devstack sudo[96184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:09:30 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:30 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-7c5a7121-c77a-44a0-98a3-3b7a3b8d8f73 req-7a86576a-286c-4e33-850c-12288cda6dbe tempest-TestInstancesWithCinderVolumes-1780519803 None] Terminate volume connection completed successfully.
Jul 09 09:09:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-7c5a7121-c77a-44a0-98a3-3b7a3b8d8f73 req-7a86576a-286c-4e33-850c-12288cda6dbe tempest-TestInstancesWithCinderVolumes-1780519803 None] Deleting attachment ef3fac32-206a-4633-bb83-7aeedb85f236. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:09:31 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.759s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:31 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:09:31 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Deleted volume successfully.
Jul 09 09:09:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-99facf79-b512-4942-823f-735c58c50908 tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-ee187a3f-49fe-4ac2-b2d0-08a0e18e4dae-delete_volume" released by "delete_volume" :: held 7.893s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-b8ad345c-2766-453f-a2a0-b045fe9e2274-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-b8ad345c-2766-453f-a2a0-b045fe9e2274-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "cinder-quobyte-b8ad345c-2766-453f-a2a0-b045fe9e2274" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-b8ad345c-2766-453f-a2a0-b045fe9e2274" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:31 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ff2034-2bce-482b-964c-23beb364ebb0]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:31 devstack sudo[96192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274
Jul 09 09:09:31 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:32 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274" returned: 0 in 0.883s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:32 devstack sudo[96198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274
Jul 09 09:09:32 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "cinder-712fe0e5-9e1c-4fcc-a300-020a3a539f81-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "cinder-712fe0e5-9e1c-4fcc-a300-020a3a539f81-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "cinder-quobyte-712fe0e5-9e1c-4fcc-a300-020a3a539f81" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "cinder-quobyte-712fe0e5-9e1c-4fcc-a300-020a3a539f81" acquired by "delete_volume" :: waited 0.029s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:32 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4290ccdb-b684-4809-af95-d51679fff28c]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:33 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b8ad345c-2766-453f-a2a0-b045fe9e2274" returned: 0 in 0.858s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:33 devstack sudo[96207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81
Jul 09 09:09:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-quobyte-b8ad345c-2766-453f-a2a0-b045fe9e2274" released by "delete_volume" :: held 1.805s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:33 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:33 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Created reservations ['92297bd0-15a9-49dd-992e-90b8416f4691', '4421e771-6bf9-42bd-8ba9-0e6b6027a015', '4e9d95ed-6784-41fa-af27-1e1a671e99b0', 'd932cf27-a69d-4b23-b1c1-be21bd1a18d9'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:09:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:33 devstack sudo[96209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:09:33 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:34 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:09:34 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:34 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Flow 'volume_create_manager' (b787dbea-a2c0-4cf4-830a-3d99e54e8909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:09:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3336468-d7b2-4b28-b102-d64031627c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81" returned: 0 in 1.463s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.004s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:34 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:09:34 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Deleted volume successfully.
Jul 09 09:09:34 devstack sudo[96215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81
Jul 09 09:09:34 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3336468-d7b2-4b28-b102-d64031627c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1443972959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c152fc-6003-4bdf-9581-1d6e07d57934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd902c6cceb74d5d9ab3a06fb314e4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:09:34Z,use_quota=True,user_id='d3b8f731f601459aa9ed72924d877f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca76639-b3dc-47cd-bb4a-4f789183c9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca76639-b3dc-47cd-bb4a-4f789183c9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490d98d6-2c0e-40b8-b98a-0c36dd29c1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:34 devstack cinder-volume[87009]: DEBUG cinder.image.glance [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Creating Keystone auth plugin from conf {{(pid=87009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 09:09:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6e9709f4-830e-441e-92cf-aa94f3359724 tempest-VolumesDeleteCascade-1064808161 None] Lock "cinder-b8ad345c-2766-453f-a2a0-b045fe9e2274-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490d98d6-2c0e-40b8-b98a-0c36dd29c1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '11c152fc-6003-4bdf-9581-1d6e07d57934', 'volume_name': 'volume-11c152fc-6003-4bdf-9581-1d6e07d57934', 'volume_size': 1, 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a39f8923563f40339681d0ff8d3f26a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'created_at': datetime.datetime(2026, 7, 9, 6, 52, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 6, 52, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/769ece37-1cae-43d1-b0fa-7053cc01926f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a92d340>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78989009-3534-4724-8e4c-18f4a9f7332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78989009-3534-4724-8e4c-18f4a9f7332f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0931c4ff-02a8-49e5-b45a-60b914c6d2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:35 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Volume 11c152fc-6003-4bdf-9581-1d6e07d57934: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-11c152fc-6003-4bdf-9581-1d6e07d57934', 'volume_size': 1, 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a39f8923563f40339681d0ff8d3f26a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'created_at': datetime.datetime(2026, 7, 9, 6, 52, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 6, 52, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/769ece37-1cae-43d1-b0fa-7053cc01926f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a92d340>}
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Trying to clone 11c152fc-6003-4bdf-9581-1d6e07d57934 from image 769ece37-1cae-43d1-b0fa-7053cc01926f at location (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]). {{(pid=87009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 09:09:35 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-712fe0e5-9e1c-4fcc-a300-020a3a539f81" returned: 0 in 0.814s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "cinder-quobyte-712fe0e5-9e1c-4fcc-a300-020a3a539f81" released by "delete_volume" :: held 2.346s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:35 devstack cinder-volume[87009]: WARNING cinder.quota [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-63911059-1376828021 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-63911059-1376828021, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:09:35 devstack cinder-volume[87009]: WARNING cinder.quota [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-63911059-1376828021 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-63911059-1376828021, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Created reservations ['10c00ec8-1162-44ca-a65c-62a2b2264a16', '1275b8d2-6d05-449e-81a6-be459fa94684', 'bc9bd29f-421b-40c8-ace2-0bd61b015e4f', 'f9a10b0b-7929-4887-be7a-d685d459a74d'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:35 devstack sudo[96219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:09:35 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_4friqgeudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 09:09:35 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Image download 20.69 MB at 20.69 MB/s
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[648fb76b-81e4-4390-abac-b682ed53f4b3]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_4friqgeudevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:35 devstack sudo[96222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_4friqgeudevstack@QuobyteHD
Jul 09 09:09:35 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:36 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.979s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:36 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:09:36 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Deleted volume successfully.
Jul 09 09:09:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-4c418897-2737-4995-be9f-8fd9886d215a tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "cinder-712fe0e5-9e1c-4fcc-a300-020a3a539f81-delete_volume" released by "delete_volume" :: held 3.846s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:36 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_4friqgeudevstack@QuobyteHD" returned: 0 in 1.141s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:36 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Temporary image 769ece37-1cae-43d1-b0fa-7053cc01926f is fetched for user d3b8f731f601459aa9ed72924d877f58. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 09:09:37 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1607999b-2f09-40eb-8a6a-9957d6ec5acf]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_4friqgeudevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:37 devstack sudo[96231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_4friqgeudevstack@QuobyteHD
Jul 09 09:09:37 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:38 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_4friqgeudevstack@QuobyteHD" returned: 0 in 1.097s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1443972959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c152fc-6003-4bdf-9581-1d6e07d57934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd902c6cceb74d5d9ab3a06fb314e4a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:09:34Z,use_quota=True,user_id='d3b8f731f601459aa9ed72924d877f58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:09:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Creating volume 11c152fc-6003-4bdf-9581-1d6e07d57934 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:09:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:09:38 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:09:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:38 devstack sudo[96240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 1073741824
Jul 09 09:09:38 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:39 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 1073741824" returned: 0 in 1.297s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:39 devstack sudo[96281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934
Jul 09 09:09:39 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:40 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934" returned: 0 in 0.900s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] <== create_volume: return (2310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:09:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.317s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:40 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Attempting download of 769ece37-1cae-43d1-b0fa-7053cc01926f ((None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}])) to volume 11c152fc-6003-4bdf-9581-1d6e07d57934. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 09:09:40 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[38512d5f-f36c-4fa7-bc8b-1fbd7a099c91]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_luv63z8r {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:40 devstack sudo[96288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_luv63z8r
Jul 09 09:09:40 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Flow 'volume_create_manager' (4030d62b-eb48-46f8-94f0-02763ef703f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a3f56f-3362-456c-bf48-945f1d4223c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a3f56f-3362-456c-bf48-945f1d4223c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-869826659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aca1610-5ed9-4075-aec3-2f0500e92974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff42a5118d64a57bda80771d84fb70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:09:41Z,use_quota=True,user_id='131083f6c3e94981866c9f5bb68e82e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db940aa8-e561-49ea-b924-061445acec0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db940aa8-e561-49ea-b924-061445acec0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d073e5-0348-413d-98e3-7bfbf6af508b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d073e5-0348-413d-98e3-7bfbf6af508b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aca1610-5ed9-4075-aec3-2f0500e92974', 'volume_name': 'volume-5aca1610-5ed9-4075-aec3-2f0500e92974', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6422f771-f7ad-4a1a-8d71-9753f1c6107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6422f771-f7ad-4a1a-8d71-9753f1c6107d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87068bd4-33f8-4611-bc82-19a0a8bd333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:41 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Volume 5aca1610-5ed9-4075-aec3-2f0500e92974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aca1610-5ed9-4075-aec3-2f0500e92974', 'volume_size': 1}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-869826659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aca1610-5ed9-4075-aec3-2f0500e92974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff42a5118d64a57bda80771d84fb70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:09:41Z,use_quota=True,user_id='131083f6c3e94981866c9f5bb68e82e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Creating volume 5aca1610-5ed9-4075-aec3-2f0500e92974 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:09:41 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5aca1610-5ed9-4075-aec3-2f0500e92974 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:41 devstack sudo[96290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5aca1610-5ed9-4075-aec3-2f0500e92974 1073741824
Jul 09 09:09:41 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:41 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_luv63z8r" returned: 0 in 0.783s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_luv63z8r {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:41 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-302716e4-f45a-4ef7-a5c0-4652201a83d5 req-71e6e6cf-1745-497e-8a42-a8760c6024b7 tempest-TestInstancesWithCinderVolumes-1780519803 None] Terminate volume connection completed successfully.
Jul 09 09:09:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-302716e4-f45a-4ef7-a5c0-4652201a83d5 req-71e6e6cf-1745-497e-8a42-a8760c6024b7 tempest-TestInstancesWithCinderVolumes-1780519803 None] Deleting attachment 38de403c-01f2-432b-988e-5756f18c74b1. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:09:41 devstack sudo[96294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_luv63z8r
Jul 09 09:09:41 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:42 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5aca1610-5ed9-4075-aec3-2f0500e92974 1073741824" returned: 0 in 1.002s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5aca1610-5ed9-4075-aec3-2f0500e92974 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:42 devstack sudo[96302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5aca1610-5ed9-4075-aec3-2f0500e92974
Jul 09 09:09:42 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:42 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_luv63z8r" returned: 1 in 0.860s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_769ece37-1cae-43d1-b0fa-7053cc01926f_luv63z8r' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:09:42 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[26248c3b-2f5e-4b1c-9f3a-fab751f79083]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_4friqgeudevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:42 devstack sudo[96304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_4friqgeudevstack@QuobyteHD
Jul 09 09:09:42 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:43 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5aca1610-5ed9-4075-aec3-2f0500e92974" returned: 0 in 0.994s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:09:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87068bd4-33f8-4611-bc82-19a0a8bd333e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aca1610-5ed9-4075-aec3-2f0500e92974', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2734ba1-31a1-4c6e-a057-d7efc6edac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:43 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Volume volume-5aca1610-5ed9-4075-aec3-2f0500e92974 (5aca1610-5ed9-4075-aec3-2f0500e92974): created successfully
Jul 09 09:09:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2734ba1-31a1-4c6e-a057-d7efc6edac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Flow 'volume_create_manager' (4030d62b-eb48-46f8-94f0-02763ef703f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:09:43 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d817027c-9034-4f8b-b0c3-a75e84692d07 tempest-VolumesTransfersV355Test-323093046 None] Created volume successfully.
Jul 09 09:09:43 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_4friqgeudevstack@QuobyteHD" returned: 0 in 1.093s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:43 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] 769ece37-1cae-43d1-b0fa-7053cc01926f was qcow2, converting to raw {{(pid=87009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 09:09:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_4friqgeudevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:43 devstack sudo[96343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_4friqgeudevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934
Jul 09 09:09:43 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:44 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2058e8db-2875-4603-9646-7907c0456b7c tempest-VolumesTransfersV355Test-262690347 None] Transfer volume completed successfully.
Jul 09 09:09:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "cinder-9f16e03b-694c-4d39-ab4f-a902515975d1-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "cinder-9f16e03b-694c-4d39-ab4f-a902515975d1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "cinder-quobyte-9f16e03b-694c-4d39-ab4f-a902515975d1" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "cinder-quobyte-9f16e03b-694c-4d39-ab4f-a902515975d1" acquired by "delete_volume" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:45 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcde586-b372-466e-a4d6-283e7d7bc381]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:45 devstack sudo[96386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1
Jul 09 09:09:45 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:45 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_4friqgeudevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934" returned: 0 in 2.498s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:45 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_769ece37-1cae-43d1-b0fa-7053cc01926f_4friqgeudevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:09:45 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Converted 112.00 MB image at 44.81 MB/s
Jul 09 09:09:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:45 devstack sudo[96390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 1G
Jul 09 09:09:45 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Acquiring lock "cinder-5aca1610-5ed9-4075-aec3-2f0500e92974-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Lock "cinder-5aca1610-5ed9-4075-aec3-2f0500e92974-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Acquiring lock "cinder-quobyte-5aca1610-5ed9-4075-aec3-2f0500e92974" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Lock "cinder-quobyte-5aca1610-5ed9-4075-aec3-2f0500e92974" acquired by "delete_volume" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:46 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda2b9e5-fe2c-4aca-aabd-986dabd0c8e5]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5aca1610-5ed9-4075-aec3-2f0500e92974 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:46 devstack sudo[96392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5aca1610-5ed9-4075-aec3-2f0500e92974
Jul 09 09:09:46 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:46 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 1G" returned: 0 in 1.031s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:46 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1" returned: 0 in 1.312s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:46 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3660f178-7941-40a3-b70a-ca000b15753c]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:47 devstack sudo[96399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1
Jul 09 09:09:47 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:47 devstack sudo[96400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934
Jul 09 09:09:47 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:47 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5aca1610-5ed9-4075-aec3-2f0500e92974" returned: 0 in 1.116s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5aca1610-5ed9-4075-aec3-2f0500e92974 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:47 devstack sudo[96406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5aca1610-5ed9-4075-aec3-2f0500e92974
Jul 09 09:09:47 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:48 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1" returned: 1 in 1.217s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:09:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:48 devstack sudo[96413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1
Jul 09 09:09:48 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:48 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934" returned: 0 in 1.251s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:48 devstack sudo[96415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934
Jul 09 09:09:48 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:48 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5aca1610-5ed9-4075-aec3-2f0500e92974" returned: 0 in 1.202s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:48 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Lock "cinder-quobyte-5aca1610-5ed9-4075-aec3-2f0500e92974" released by "delete_volume" :: held 2.373s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:48 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Created reservations ['5bd8140b-a4e7-4a31-9227-f6d3e0700d8b', '2d2822d8-2297-46d5-a8c6-addf1c0745cd', '3a5a6bd1-ea90-4aa9-8348-bffbfc40518f', 'c1efe0a9-d43a-4f7d-ac77-67ae208d6119'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:09:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:49 devstack sudo[96420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:09:49 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:49 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9f16e03b-694c-4d39-ab4f-a902515975d1" returned: 0 in 1.106s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "cinder-quobyte-9f16e03b-694c-4d39-ab4f-a902515975d1" released by "delete_volume" :: held 3.759s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:49 devstack cinder-volume[87009]: WARNING cinder.quota [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1661572958-1113378184 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1661572958-1113378184, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:09:49 devstack cinder-volume[87009]: WARNING cinder.quota [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1661572958-1113378184 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1661572958-1113378184, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Created reservations ['b82ad336-e7fd-4e44-a14c-d7cc6f0f0b07', '11fe7ed4-b160-4ec0-9b7b-fcc91a7b0705', '80101284-01e3-4bf4-9b67-f75551f6f4cc', '978fd7c8-99f6-4e28-aec3-244be059bf8e'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:09:49 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934" returned: 1 in 1.184s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Downloaded image 769ece37-1cae-43d1-b0fa-7053cc01926f ((None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}])) to volume 11c152fc-6003-4bdf-9581-1d6e07d57934 successfully. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Temporary image 769ece37-1cae-43d1-b0fa-7053cc01926f for user d3b8f731f601459aa9ed72924d877f58 is deleted. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Marking volume 11c152fc-6003-4bdf-9581-1d6e07d57934 as bootable. {{(pid=87009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Copying metadata from image 769ece37-1cae-43d1-b0fa-7053cc01926f to 11c152fc-6003-4bdf-9581-1d6e07d57934. {{(pid=87009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Creating volume glance metadata for volume 11c152fc-6003-4bdf-9581-1d6e07d57934 backed by image 769ece37-1cae-43d1-b0fa-7053cc01926f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:49 devstack sudo[96427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:09:49 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0931c4ff-02a8-49e5-b45a-60b914c6d2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c152fc-6003-4bdf-9581-1d6e07d57934', 'volume_size': 1, 'image_id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/769ece37-1cae-43d1-b0fa-7053cc01926f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a39f8923563f40339681d0ff8d3f26a3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '769ece37-1cae-43d1-b0fa-7053cc01926f', 'created_at': datetime.datetime(2026, 7, 9, 6, 52, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 6, 52, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/769ece37-1cae-43d1-b0fa-7053cc01926f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a92d340>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd027646-4a5c-459a-9e2f-d4d200bfabc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:49 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Volume volume-11c152fc-6003-4bdf-9581-1d6e07d57934 (11c152fc-6003-4bdf-9581-1d6e07d57934): created successfully
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd027646-4a5c-459a-9e2f-d4d200bfabc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Flow 'volume_create_manager' (b787dbea-a2c0-4cf4-830a-3d99e54e8909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:09:49 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b30c68d4-4d49-4c7d-950b-d7604c159a2a tempest-TestShelveInstance-1397742482 None] Created volume successfully.
Jul 09 09:09:50 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.126s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:09:50 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Deleted volume successfully.
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-aafc96fd-b19b-4852-8ea7-9e882be9ba2f tempest-VolumesTransfersV355Test-335308976 None] Lock "cinder-5aca1610-5ed9-4075-aec3-2f0500e92974-delete_volume" released by "delete_volume" :: held 3.959s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Flow 'volume_create_manager' (fa90fb34-fa7f-4838-915b-f51a788c4b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac9b350-842b-4823-a58b-45072b1192eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac9b350-842b-4823-a58b-45072b1192eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1636080259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4262d63b-536d-44fd-959a-16e6b82ffdd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff42a5118d64a57bda80771d84fb70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:09:50Z,use_quota=True,user_id='131083f6c3e94981866c9f5bb68e82e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a12594-a5d0-4a43-ada8-c9cd36a307cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a12594-a5d0-4a43-ada8-c9cd36a307cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457bc059-2feb-4c94-9255-e722438026cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457bc059-2feb-4c94-9255-e722438026cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4262d63b-536d-44fd-959a-16e6b82ffdd9', 'volume_name': 'volume-4262d63b-536d-44fd-959a-16e6b82ffdd9', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b034414f-1b4c-4743-995c-f308e9da4cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b034414f-1b4c-4743-995c-f308e9da4cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d0d469-cf0d-42da-9658-4ea62049aad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:50 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Volume 4262d63b-536d-44fd-959a-16e6b82ffdd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4262d63b-536d-44fd-959a-16e6b82ffdd9', 'volume_size': 1}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1636080259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4262d63b-536d-44fd-959a-16e6b82ffdd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff42a5118d64a57bda80771d84fb70c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:09:50Z,use_quota=True,user_id='131083f6c3e94981866c9f5bb68e82e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:09:50 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Creating volume 4262d63b-536d-44fd-959a-16e6b82ffdd9 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:09:50 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4262d63b-536d-44fd-959a-16e6b82ffdd9 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.183s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:09:50 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Deleted volume successfully.
Jul 09 09:09:50 devstack sudo[96431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4262d63b-536d-44fd-959a-16e6b82ffdd9 1073741824
Jul 09 09:09:50 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-eeeddc3d-06ff-47b1-9465-4ca04301709b tempest-TestInstancesWithCinderVolumes-1780519803 None] Lock "cinder-9f16e03b-694c-4d39-ab4f-a902515975d1-delete_volume" released by "delete_volume" :: held 5.380s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:51 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4262d63b-536d-44fd-959a-16e6b82ffdd9 1073741824" returned: 0 in 1.300s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4262d63b-536d-44fd-959a-16e6b82ffdd9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:52 devstack sudo[96439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4262d63b-536d-44fd-959a-16e6b82ffdd9
Jul 09 09:09:52 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:52 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4262d63b-536d-44fd-959a-16e6b82ffdd9" returned: 0 in 0.834s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] <== create_volume: return (2220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:09:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d0d469-cf0d-42da-9658-4ea62049aad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4262d63b-536d-44fd-959a-16e6b82ffdd9', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df55db70-035f-4e98-ab3c-e37801925b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:09:52 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Volume volume-4262d63b-536d-44fd-959a-16e6b82ffdd9 (4262d63b-536d-44fd-959a-16e6b82ffdd9): created successfully
Jul 09 09:09:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df55db70-035f-4e98-ab3c-e37801925b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:09:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Flow 'volume_create_manager' (fa90fb34-fa7f-4838-915b-f51a788c4b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:09:52 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-81312309-877d-4c09-a4cd-ee9bf766961d tempest-VolumesTransfersV355Test-323093046 None] Created volume successfully.
Jul 09 09:09:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Acquiring lock "cinder-4262d63b-536d-44fd-959a-16e6b82ffdd9-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Lock "cinder-4262d63b-536d-44fd-959a-16e6b82ffdd9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Acquiring lock "cinder-quobyte-4262d63b-536d-44fd-959a-16e6b82ffdd9" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:09:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Lock "cinder-quobyte-4262d63b-536d-44fd-959a-16e6b82ffdd9" acquired by "delete_volume" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:09:54 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[97319ddc-918b-4de7-9d82-dd9205b8f48a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4262d63b-536d-44fd-959a-16e6b82ffdd9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:09:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:54 devstack sudo[96443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4262d63b-536d-44fd-959a-16e6b82ffdd9
Jul 09 09:09:54 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:54 devstack sudo[96444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:09:54 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:55 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4262d63b-536d-44fd-959a-16e6b82ffdd9" returned: 0 in 1.080s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4262d63b-536d-44fd-959a-16e6b82ffdd9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:55 devstack sudo[96453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4262d63b-536d-44fd-959a-16e6b82ffdd9
Jul 09 09:09:55 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:55 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.202s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:09:55 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:09:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:09:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:09:56 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4262d63b-536d-44fd-959a-16e6b82ffdd9" returned: 0 in 0.931s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Lock "cinder-quobyte-4262d63b-536d-44fd-959a-16e6b82ffdd9" released by "delete_volume" :: held 2.058s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:56 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Created reservations ['2bdd3c68-e491-4d30-9b65-a04d3d6d97e3', '6fb29ead-0cfb-4a1f-985d-915b7f69feca', '5eb81610-3607-49d1-b29f-d3069e8a805a', 'f3aef8f4-1054-401f-9f07-b52383593239'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:09:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:09:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:09:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:09:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:56 devstack sudo[96465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:09:56 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:09:57 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root
Jul 09 09:09:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.067s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:09:57 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:09:57 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Deleted volume successfully.
Jul 09 09:09:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-338dd196-1b6c-4a3f-abc5-1ae981ce01cb tempest-VolumesTransfersV355Test-335308976 None] Lock "cinder-4262d63b-536d-44fd-959a-16e6b82ffdd9-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:09:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-6515c434-8555-4cf8-811f-9cc6e5a769f1 req-1e7961fc-239a-4410-9a2a-3ebe1a68b788 tempest-TestShelveInstance-1397742482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:09:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-6515c434-8555-4cf8-811f-9cc6e5a769f1 req-1e7961fc-239a-4410-9a2a-3ebe1a68b788 tempest-TestShelveInstance-1397742482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:09:59 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[339c1755-3e49-4960-a398-661494551edc]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:09:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-6515c434-8555-4cf8-811f-9cc6e5a769f1 req-1e7961fc-239a-4410-9a2a-3ebe1a68b788 tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:09:59 devstack sudo[96492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934
Jul 09 09:09:59 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:00 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-6515c434-8555-4cf8-811f-9cc6e5a769f1 req-1e7961fc-239a-4410-9a2a-3ebe1a68b788 tempest-TestShelveInstance-1397742482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934" returned: 0 in 0.789s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-6515c434-8555-4cf8-811f-9cc6e5a769f1 req-1e7961fc-239a-4410-9a2a-3ebe1a68b788 tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:00 devstack sudo[96496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934
Jul 09 09:10:00 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:01 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-6515c434-8555-4cf8-811f-9cc6e5a769f1 req-1e7961fc-239a-4410-9a2a-3ebe1a68b788 tempest-TestShelveInstance-1397742482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934" returned: 1 in 0.915s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-6515c434-8555-4cf8-811f-9cc6e5a769f1 req-1e7961fc-239a-4410-9a2a-3ebe1a68b788 tempest-TestShelveInstance-1397742482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:10:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-6515c434-8555-4cf8-811f-9cc6e5a769f1 req-1e7961fc-239a-4410-9a2a-3ebe1a68b788 tempest-TestShelveInstance-1397742482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.751s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:01 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-6515c434-8555-4cf8-811f-9cc6e5a769f1 req-1e7961fc-239a-4410-9a2a-3ebe1a68b788 tempest-TestShelveInstance-1397742482 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-11c152fc-6003-4bdf-9581-1d6e07d57934', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4f5772a-884c-4f99-af7c-1765a05d16d0', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:10:01 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-6515c434-8555-4cf8-811f-9cc6e5a769f1 req-1e7961fc-239a-4410-9a2a-3ebe1a68b788 tempest-TestShelveInstance-1397742482 None] attachment_update completed successfully.
Jul 09 09:10:06 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:10:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Flow 'volume_create_manager' (7eca9bad-ddbf-4453-a50a-5423a6f3b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ca6afc-28b7-44c5-b9f6-ba237b881c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ca6afc-28b7-44c5-b9f6-ba237b881c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-683711780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca3c1017-2863-40f4-a7de-68d934bf6612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1040d8189b3a418a891b2499b4443cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:07Z,use_quota=True,user_id='2f9cd96c861f4b07b4d2a82bd08508c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20eff3c3-1d0c-4b4d-9fce-d0b6df8f8163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20eff3c3-1d0c-4b4d-9fce-d0b6df8f8163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9235859-4c8e-4703-8835-d1c5fe9bebcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9235859-4c8e-4703-8835-d1c5fe9bebcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca3c1017-2863-40f4-a7de-68d934bf6612', 'volume_name': 'volume-ca3c1017-2863-40f4-a7de-68d934bf6612', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5340e37d-7317-49bf-a402-1c45d781e8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5340e37d-7317-49bf-a402-1c45d781e8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baeff35f-49a6-4002-9f0f-63ff4af9ee36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:07 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Volume ca3c1017-2863-40f4-a7de-68d934bf6612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca3c1017-2863-40f4-a7de-68d934bf6612', 'volume_size': 1}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-683711780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca3c1017-2863-40f4-a7de-68d934bf6612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1040d8189b3a418a891b2499b4443cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:07Z,use_quota=True,user_id='2f9cd96c861f4b07b4d2a82bd08508c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Creating volume ca3c1017-2863-40f4-a7de-68d934bf6612 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:10:07 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ca3c1017-2863-40f4-a7de-68d934bf6612 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:07 devstack sudo[96939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ca3c1017-2863-40f4-a7de-68d934bf6612 1073741824
Jul 09 09:10:07 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Flow 'volume_create_manager' (30ecef0e-3190-43d2-bd88-80801eaea33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5c2f03-562d-4b51-aab1-e010a8ad92a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5c2f03-562d-4b51-aab1-e010a8ad92a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1361296739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a31024-f945-442f-a4ac-f54c538a4cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1040d8189b3a418a891b2499b4443cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:07Z,use_quota=True,user_id='2f9cd96c861f4b07b4d2a82bd08508c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662070bb-e380-4973-b6ca-4d7dbd588f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662070bb-e380-4973-b6ca-4d7dbd588f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14365711-3cb6-45bd-a214-c597f5ce370d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14365711-3cb6-45bd-a214-c597f5ce370d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07a31024-f945-442f-a4ac-f54c538a4cd0', 'volume_name': 'volume-07a31024-f945-442f-a4ac-f54c538a4cd0', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4658f7e-32f8-47ea-8320-279d44783b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4658f7e-32f8-47ea-8320-279d44783b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11abee54-cd86-40c9-ba63-5f56f527410f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:07 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Volume 07a31024-f945-442f-a4ac-f54c538a4cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07a31024-f945-442f-a4ac-f54c538a4cd0', 'volume_size': 1}
Jul 09 09:10:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Flow 'volume_create_manager' (ece5d2e3-12b3-4fde-8f9f-152d4982da7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ec0edb-070d-4716-a45a-24ba8ed68bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ec0edb-070d-4716-a45a-24ba8ed68bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-739014166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b68a72-2bf7-4620-9f7d-2b1cae5a87d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1040d8189b3a418a891b2499b4443cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:08Z,use_quota=True,user_id='2f9cd96c861f4b07b4d2a82bd08508c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376a6bb9-1194-479b-92c8-f0af9f20b770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376a6bb9-1194-479b-92c8-f0af9f20b770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8a0192-cb59-4c86-86ea-87c351569374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8a0192-cb59-4c86-86ea-87c351569374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b68a72-2bf7-4620-9f7d-2b1cae5a87d1', 'volume_name': 'volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce1ca11-c85a-4d40-b25b-71a61c151f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce1ca11-c85a-4d40-b25b-71a61c151f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a521ef-9a88-4f0f-9d66-5f10eec27c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:08 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Volume 25b68a72-2bf7-4620-9f7d-2b1cae5a87d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1', 'volume_size': 1}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:10:08 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Flow 'volume_create_manager' (0422191d-9c80-4978-adbf-0fa625444e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997a1de5-673b-4616-b512-c3f1f5c55d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ca3c1017-2863-40f4-a7de-68d934bf6612 1073741824" returned: 0 in 1.513s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997a1de5-673b-4616-b512-c3f1f5c55d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1030076339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ed620d-17e9-4235-ac2f-390352db37cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1040d8189b3a418a891b2499b4443cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:08Z,use_quota=True,user_id='2f9cd96c861f4b07b4d2a82bd08508c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a338b7e-9f3e-4bda-a2c6-ef9b58c70380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a338b7e-9f3e-4bda-a2c6-ef9b58c70380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69447843-d874-4062-b5e3-fe863b11a845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69447843-d874-4062-b5e3-fe863b11a845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ed620d-17e9-4235-ac2f-390352db37cc', 'volume_name': 'volume-b1ed620d-17e9-4235-ac2f-390352db37cc', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de8ab45-8d0f-4f8d-b7da-af963c7f414e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de8ab45-8d0f-4f8d-b7da-af963c7f414e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bf10f0-9f67-4702-ac4a-4492a32a3691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:08 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Volume b1ed620d-17e9-4235-ac2f-390352db37cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ed620d-17e9-4235-ac2f-390352db37cc', 'volume_size': 1}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ca3c1017-2863-40f4-a7de-68d934bf6612 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:08 devstack sudo[96956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ca3c1017-2863-40f4-a7de-68d934bf6612
Jul 09 09:10:08 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Flow 'volume_create_manager' (80998998-9a15-4c39-93a4-2d29f23adf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d297e8-9b31-4f24-95cb-dbfcc376752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d297e8-9b31-4f24-95cb-dbfcc376752f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1951045888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c2d372-e284-4672-94e8-1a29a94d1b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1040d8189b3a418a891b2499b4443cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:09Z,use_quota=True,user_id='2f9cd96c861f4b07b4d2a82bd08508c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ad493c-a108-4718-bfc0-fa850a0d7210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ad493c-a108-4718-bfc0-fa850a0d7210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad53924b-5c86-4d6c-8df2-9bc740ae6aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad53924b-5c86-4d6c-8df2-9bc740ae6aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5c2d372-e284-4672-94e8-1a29a94d1b47', 'volume_name': 'volume-b5c2d372-e284-4672-94e8-1a29a94d1b47', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c705c1d-87cd-42b9-8d70-4ae7cd38d2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c705c1d-87cd-42b9-8d70-4ae7cd38d2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3053a8ea-dd55-4305-8911-7fd87c163ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:09 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Volume b5c2d372-e284-4672-94e8-1a29a94d1b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5c2d372-e284-4672-94e8-1a29a94d1b47', 'volume_size': 1}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:09 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ca3c1017-2863-40f4-a7de-68d934bf6612" returned: 0 in 1.129s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] <== create_volume: return (2767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.772s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.205s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1361296739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a31024-f945-442f-a4ac-f54c538a4cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1040d8189b3a418a891b2499b4443cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:07Z,use_quota=True,user_id='2f9cd96c861f4b07b4d2a82bd08508c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Creating volume 07a31024-f945-442f-a4ac-f54c538a4cd0 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:10:09 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-07a31024-f945-442f-a4ac-f54c538a4cd0 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baeff35f-49a6-4002-9f0f-63ff4af9ee36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca3c1017-2863-40f4-a7de-68d934bf6612', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7c8b6e-28b9-4c8d-8b3a-b7c962fe1003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:09 devstack sudo[96962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-07a31024-f945-442f-a4ac-f54c538a4cd0 1073741824
Jul 09 09:10:09 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:09 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Volume volume-ca3c1017-2863-40f4-a7de-68d934bf6612 (ca3c1017-2863-40f4-a7de-68d934bf6612): created successfully
Jul 09 09:10:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7c8b6e-28b9-4c8d-8b3a-b7c962fe1003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Flow 'volume_create_manager' (7eca9bad-ddbf-4453-a50a-5423a6f3b933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-dcef4be1-0a57-4b78-9351-32da91c24020 tempest-CreateVolumesFromImageTest-577124136 None] Created volume successfully.
Jul 09 09:10:10 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:10:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Flow 'volume_create_manager' (e8f916c4-df52-4b61-b32f-f35eb16a7a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269f2158-0e72-4ffb-90d3-3a1c03c448e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269f2158-0e72-4ffb-90d3-3a1c03c448e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-499940708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1408f5e5-3ed9-4388-b35f-82f11382eda7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c6222df283401caca446fdb53a45de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:10Z,use_quota=True,user_id='ba1d93647a4f45a4ad99cfcbf7e452a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9dabfa0-2797-46d8-bf00-1867b93319a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9dabfa0-2797-46d8-bf00-1867b93319a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0887c21d-bb43-4241-9f79-9981976eaaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0887c21d-bb43-4241-9f79-9981976eaaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1408f5e5-3ed9-4388-b35f-82f11382eda7', 'volume_name': 'volume-1408f5e5-3ed9-4388-b35f-82f11382eda7', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774489dd-69f5-4f1f-8f89-59edbc9a840d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774489dd-69f5-4f1f-8f89-59edbc9a840d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48ad30f-27fb-4b02-8f57-73daa466f0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:10 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Volume 1408f5e5-3ed9-4388-b35f-82f11382eda7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1408f5e5-3ed9-4388-b35f-82f11382eda7', 'volume_size': 1}
Jul 09 09:10:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:11 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-07a31024-f945-442f-a4ac-f54c538a4cd0 1073741824" returned: 0 in 1.550s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-07a31024-f945-442f-a4ac-f54c538a4cd0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:11 devstack sudo[96967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-07a31024-f945-442f-a4ac-f54c538a4cd0
Jul 09 09:10:11 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:12 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-07a31024-f945-442f-a4ac-f54c538a4cd0" returned: 0 in 1.073s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] <== create_volume: return (2689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.693s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.240s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-739014166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b68a72-2bf7-4620-9f7d-2b1cae5a87d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1040d8189b3a418a891b2499b4443cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:08Z,use_quota=True,user_id='2f9cd96c861f4b07b4d2a82bd08508c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Creating volume 25b68a72-2bf7-4620-9f7d-2b1cae5a87d1 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:10:12 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11abee54-cd86-40c9-ba63-5f56f527410f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a31024-f945-442f-a4ac-f54c538a4cd0', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a062dd1-76ab-4e53-abbe-866b2e763c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:12 devstack sudo[96970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1 1073741824
Jul 09 09:10:12 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:12 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Volume volume-07a31024-f945-442f-a4ac-f54c538a4cd0 (07a31024-f945-442f-a4ac-f54c538a4cd0): created successfully
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a062dd1-76ab-4e53-abbe-866b2e763c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Flow 'volume_create_manager' (30ecef0e-3190-43d2-bd88-80801eaea33b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:12 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-54e1272d-d166-4546-9001-d74b5faaa55a tempest-CreateVolumesFromImageTest-577124136 None] Created volume successfully.
Jul 09 09:10:13 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1 1073741824" returned: 0 in 1.261s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:13 devstack sudo[96976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1
Jul 09 09:10:13 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:15 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1" returned: 0 in 1.127s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] <== create_volume: return (2454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.459s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.326s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1030076339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ed620d-17e9-4235-ac2f-390352db37cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1040d8189b3a418a891b2499b4443cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:08Z,use_quota=True,user_id='2f9cd96c861f4b07b4d2a82bd08508c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Creating volume b1ed620d-17e9-4235-ac2f-390352db37cc {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:10:15 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b1ed620d-17e9-4235-ac2f-390352db37cc 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a521ef-9a88-4f0f-9d66-5f10eec27c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:15 devstack sudo[96979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b1ed620d-17e9-4235-ac2f-390352db37cc 1073741824
Jul 09 09:10:15 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1f925a-27f9-41c8-b753-cac10d7baa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:15 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Volume volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1 (25b68a72-2bf7-4620-9f7d-2b1cae5a87d1): created successfully
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1f925a-27f9-41c8-b753-cac10d7baa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:15 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Flow 'volume_create_manager' (ece5d2e3-12b3-4fde-8f9f-152d4982da7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:15 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-356c2b08-ddbf-408f-9a8d-2e917c428a96 tempest-CreateVolumesFromImageTest-577124136 None] Created volume successfully.
Jul 09 09:10:16 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b1ed620d-17e9-4235-ac2f-390352db37cc 1073741824" returned: 0 in 1.394s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b1ed620d-17e9-4235-ac2f-390352db37cc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:16 devstack sudo[96985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b1ed620d-17e9-4235-ac2f-390352db37cc
Jul 09 09:10:16 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:17 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b1ed620d-17e9-4235-ac2f-390352db37cc" returned: 0 in 1.278s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] <== create_volume: return (2731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.735s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.370s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1951045888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c2d372-e284-4672-94e8-1a29a94d1b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1040d8189b3a418a891b2499b4443cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:09Z,use_quota=True,user_id='2f9cd96c861f4b07b4d2a82bd08508c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Creating volume b5c2d372-e284-4672-94e8-1a29a94d1b47 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:10:17 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b5c2d372-e284-4672-94e8-1a29a94d1b47 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:17 devstack sudo[96989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b5c2d372-e284-4672-94e8-1a29a94d1b47 1073741824
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bf10f0-9f67-4702-ac4a-4492a32a3691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ed620d-17e9-4235-ac2f-390352db37cc', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:17 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9228d656-19ae-47c2-9c80-15ad04eb211c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:17 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Volume volume-b1ed620d-17e9-4235-ac2f-390352db37cc (b1ed620d-17e9-4235-ac2f-390352db37cc): created successfully
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9228d656-19ae-47c2-9c80-15ad04eb211c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Flow 'volume_create_manager' (0422191d-9c80-4978-adbf-0fa625444e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:17 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-70cf153f-5549-4245-b00d-0a64f7f5a0bd tempest-CreateVolumesFromImageTest-577124136 None] Created volume successfully.
Jul 09 09:10:18 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b5c2d372-e284-4672-94e8-1a29a94d1b47 1073741824" returned: 0 in 1.145s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:18 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Flow 'volume_create_manager' (3577de72-6df5-408a-a7c5-38b9e00255d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44fdbbf8-7083-449e-bc97-69ef027dc159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b5c2d372-e284-4672-94e8-1a29a94d1b47 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:19 devstack sudo[96996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b5c2d372-e284-4672-94e8-1a29a94d1b47
Jul 09 09:10:19 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44fdbbf8-7083-449e-bc97-69ef027dc159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-748442859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d715f44-d565-4e4c-9602-4517a6852367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768c960ef8a84925a41b47cf21338c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:19Z,use_quota=True,user_id='4ff323afceca4010860a84df9be11a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0156011-c03a-4dd6-aac6-3e27137cb276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0156011-c03a-4dd6-aac6-3e27137cb276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c22f699-1c2a-4efc-8b9d-3775cf98a3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c22f699-1c2a-4efc-8b9d-3775cf98a3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d715f44-d565-4e4c-9602-4517a6852367', 'volume_name': 'volume-3d715f44-d565-4e4c-9602-4517a6852367', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7540ae-a547-46c1-a678-b070267d454f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7540ae-a547-46c1-a678-b070267d454f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a6eccc-ee75-4255-8d88-3d249a271efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:19 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Volume 3d715f44-d565-4e4c-9602-4517a6852367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d715f44-d565-4e4c-9602-4517a6852367', 'volume_size': 1}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:19 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b5c2d372-e284-4672-94e8-1a29a94d1b47" returned: 0 in 0.667s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.208s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-499940708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1408f5e5-3ed9-4388-b35f-82f11382eda7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c6222df283401caca446fdb53a45de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:10Z,use_quota=True,user_id='ba1d93647a4f45a4ad99cfcbf7e452a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Creating volume 1408f5e5-3ed9-4388-b35f-82f11382eda7 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:10:19 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:19 devstack sudo[96999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7 1073741824
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3053a8ea-dd55-4305-8911-7fd87c163ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5c2d372-e284-4672-94e8-1a29a94d1b47', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:19 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6edf5a2-199b-4095-bad0-0dcc542b5b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:19 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Volume volume-b5c2d372-e284-4672-94e8-1a29a94d1b47 (b5c2d372-e284-4672-94e8-1a29a94d1b47): created successfully
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6edf5a2-199b-4095-bad0-0dcc542b5b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Flow 'volume_create_manager' (80998998-9a15-4c39-93a4-2d29f23adf5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:19 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-9a6c6c0e-1ead-4187-afe3-e56c270fbf65 tempest-CreateVolumesFromImageTest-577124136 None] Created volume successfully.
Jul 09 09:10:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "cinder-b5c2d372-e284-4672-94e8-1a29a94d1b47-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-b5c2d372-e284-4672-94e8-1a29a94d1b47-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:20 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7 1073741824" returned: 0 in 0.913s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "cinder-quobyte-b5c2d372-e284-4672-94e8-1a29a94d1b47" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-quobyte-b5c2d372-e284-4672-94e8-1a29a94d1b47" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:20 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4998883f-9546-42d5-b2ee-ad3513b24ce9]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:10:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b5c2d372-e284-4672-94e8-1a29a94d1b47 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:20 devstack sudo[97005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7
Jul 09 09:10:20 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:20 devstack sudo[97006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b5c2d372-e284-4672-94e8-1a29a94d1b47
Jul 09 09:10:20 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:21 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7" returned: 0 in 0.788s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.363s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-748442859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d715f44-d565-4e4c-9602-4517a6852367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768c960ef8a84925a41b47cf21338c20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:19Z,use_quota=True,user_id='4ff323afceca4010860a84df9be11a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Creating volume 3d715f44-d565-4e4c-9602-4517a6852367 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:10:21 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48ad30f-27fb-4b02-8f57-73daa466f0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1408f5e5-3ed9-4388-b35f-82f11382eda7', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f44728-0f47-4731-b8c8-6599c526da5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:21 devstack sudo[97049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 1073741824
Jul 09 09:10:21 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:21 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Volume volume-1408f5e5-3ed9-4388-b35f-82f11382eda7 (1408f5e5-3ed9-4388-b35f-82f11382eda7): created successfully
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f44728-0f47-4731-b8c8-6599c526da5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Flow 'volume_create_manager' (e8f916c4-df52-4b61-b32f-f35eb16a7a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:21 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2fec1da5-abe9-4b3a-ad03-f90ac46dc433 tempest-AttachVolumeTestJSON-2089683209 None] Created volume successfully.
Jul 09 09:10:21 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b5c2d372-e284-4672-94e8-1a29a94d1b47" returned: 0 in 0.933s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b5c2d372-e284-4672-94e8-1a29a94d1b47 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:21 devstack sudo[97051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b5c2d372-e284-4672-94e8-1a29a94d1b47
Jul 09 09:10:21 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:22 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b5c2d372-e284-4672-94e8-1a29a94d1b47" returned: 0 in 0.688s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-quobyte-b5c2d372-e284-4672-94e8-1a29a94d1b47" released by "delete_volume" :: held 1.681s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=85,cinder:UPDATE=97,cinder:DELETE=11,cinder:INSERT=31 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=92,cinder:SELECT=73,cinder:INSERT=23,cinder:DELETE=6 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:10:22 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 1073741824" returned: 0 in 0.901s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Created reservations ['a384995d-39dc-4c95-9c43-a0195d722feb', '2cceec84-b02d-4846-8f7d-1d774b052f29', '9f8d0d4e-4ba3-4c0f-a6e5-0fff7d966d09', '959a2f47-a192-4cec-8d80-4bec374c3e50'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:22 devstack sudo[97059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367
Jul 09 09:10:22 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:22 devstack sudo[97062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:10:22 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "cinder-b1ed620d-17e9-4235-ac2f-390352db37cc-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-b1ed620d-17e9-4235-ac2f-390352db37cc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "cinder-quobyte-b1ed620d-17e9-4235-ac2f-390352db37cc" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-quobyte-b1ed620d-17e9-4235-ac2f-390352db37cc" acquired by "delete_volume" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:23 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8681c8d-be42-4167-b266-b527ba8311a1]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:10:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b1ed620d-17e9-4235-ac2f-390352db37cc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:23 devstack sudo[97067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b1ed620d-17e9-4235-ac2f-390352db37cc
Jul 09 09:10:23 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:23 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.797s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:23 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:10:23 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Deleted volume successfully.
Jul 09 09:10:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b43b4cef-faaa-4a2a-bd1b-bbb1f99b82f5 tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-b5c2d372-e284-4672-94e8-1a29a94d1b47-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:10:23 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367" returned: 0 in 1.031s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:10:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a6eccc-ee75-4255-8d88-3d249a271efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d715f44-d565-4e4c-9602-4517a6852367', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ba0538-f7b1-4261-9e82-32f6322638f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:23 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Volume volume-3d715f44-d565-4e4c-9602-4517a6852367 (3d715f44-d565-4e4c-9602-4517a6852367): created successfully
Jul 09 09:10:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ba0538-f7b1-4261-9e82-32f6322638f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Flow 'volume_create_manager' (3577de72-6df5-408a-a7c5-38b9e00255d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:23 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f6d3ae08-dc3a-4b0d-bce3-80a9af77a2a3 tempest-VolumesActionsTest-1677061414 None] Created volume successfully.
Jul 09 09:10:24 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b1ed620d-17e9-4235-ac2f-390352db37cc" returned: 0 in 1.003s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b1ed620d-17e9-4235-ac2f-390352db37cc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:24 devstack sudo[97181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b1ed620d-17e9-4235-ac2f-390352db37cc
Jul 09 09:10:24 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:24 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b1ed620d-17e9-4235-ac2f-390352db37cc" returned: 0 in 0.678s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:24 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-quobyte-b1ed620d-17e9-4235-ac2f-390352db37cc" released by "delete_volume" :: held 1.747s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:10:24 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Created reservations ['cc53fab8-98ca-4f16-a550-9d942f45c09e', 'b4babf9c-06d1-4c46-a7aa-19735823d5a8', '2a0b4f8c-30f3-4404-a26c-dbdc7f0592be', '68742c53-a186-48df-a05e-243b2a64144d'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:10:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:24 devstack sudo[97184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:10:24 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "cinder-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "cinder-quobyte-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-quobyte-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1" acquired by "delete_volume" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:25 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca1ee0e-6b8f-4dbb-bf5f-7e9fb14a9e27]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:10:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:25 devstack sudo[97195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1
Jul 09 09:10:25 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-1fdd9a94-9bcb-4578-a350-c925be2f89fa req-262436c8-8c5b-4e11-a50d-bbca1654b8a6 tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-1fdd9a94-9bcb-4578-a350-c925be2f89fa req-262436c8-8c5b-4e11-a50d-bbca1654b8a6 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:25 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73d89c2-b9cd-428b-a91e-a38704265392]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:10:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-1fdd9a94-9bcb-4578-a350-c925be2f89fa req-262436c8-8c5b-4e11-a50d-bbca1654b8a6 tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:25 devstack sudo[97199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7
Jul 09 09:10:25 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:25 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.920s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:25 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:10:25 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Deleted volume successfully.
Jul 09 09:10:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5379a834-3105-4787-9aad-04a664d396b5 tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-b1ed620d-17e9-4235-ac2f-390352db37cc-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:10:26 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1" returned: 0 in 0.846s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:26 devstack sudo[97205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1
Jul 09 09:10:26 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:26 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-1fdd9a94-9bcb-4578-a350-c925be2f89fa req-262436c8-8c5b-4e11-a50d-bbca1654b8a6 tempest-AttachVolumeTestJSON-2089683209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7" returned: 0 in 0.847s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-1fdd9a94-9bcb-4578-a350-c925be2f89fa req-262436c8-8c5b-4e11-a50d-bbca1654b8a6 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.867s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-1fdd9a94-9bcb-4578-a350-c925be2f89fa req-262436c8-8c5b-4e11-a50d-bbca1654b8a6 tempest-AttachVolumeTestJSON-2089683209 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-1408f5e5-3ed9-4388-b35f-82f11382eda7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9f6cf0c-99ca-43ce-b7bc-f5dd6a4331db', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:10:26 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-1fdd9a94-9bcb-4578-a350-c925be2f89fa req-262436c8-8c5b-4e11-a50d-bbca1654b8a6 tempest-AttachVolumeTestJSON-2089683209 None] attachment_update completed successfully.
Jul 09 09:10:26 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1" returned: 0 in 0.664s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-quobyte-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1" released by "delete_volume" :: held 1.564s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Created reservations ['a8c5a7c4-9a7b-4597-be7a-59f2baa157d9', '65494861-f2a5-4633-8a73-9f46ece0bbda', '4db815c2-a511-4cb9-a014-94dbdb57f556', '66713fb1-66ea-4b91-b3f2-8d95a7846512'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:27 devstack sudo[97211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:10:27 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "cinder-07a31024-f945-442f-a4ac-f54c538a4cd0-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-07a31024-f945-442f-a4ac-f54c538a4cd0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "cinder-quobyte-07a31024-f945-442f-a4ac-f54c538a4cd0" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-quobyte-07a31024-f945-442f-a4ac-f54c538a4cd0" acquired by "delete_volume" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c92eb7c-3361-4b32-9971-c846e9c9cc5e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-07a31024-f945-442f-a4ac-f54c538a4cd0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:27 devstack sudo[97213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-07a31024-f945-442f-a4ac-f54c538a4cd0
Jul 09 09:10:27 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:27 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.691s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:10:27 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Deleted volume successfully.
Jul 09 09:10:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88520d3b-734e-4073-a16c-de7e958868ec tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-25b68a72-2bf7-4620-9f7d-2b1cae5a87d1-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:10:28 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-07a31024-f945-442f-a4ac-f54c538a4cd0" returned: 0 in 0.810s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-07a31024-f945-442f-a4ac-f54c538a4cd0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:28 devstack sudo[97221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-07a31024-f945-442f-a4ac-f54c538a4cd0
Jul 09 09:10:28 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:29 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-07a31024-f945-442f-a4ac-f54c538a4cd0" returned: 0 in 0.653s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-quobyte-07a31024-f945-442f-a4ac-f54c538a4cd0" released by "delete_volume" :: held 1.510s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Created reservations ['8fccc4f9-1647-42dd-8e61-fea3443120be', 'c5b48b47-2c27-4440-8a05-aacab6f32753', '0bb9d274-bc5f-4b8d-b7c5-8bf94cb1ae43', '69a797c1-a45b-422d-869d-69089ef970bf'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:29 devstack sudo[97225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:10:29 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "cinder-ca3c1017-2863-40f4-a7de-68d934bf6612-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-ca3c1017-2863-40f4-a7de-68d934bf6612-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "cinder-quobyte-ca3c1017-2863-40f4-a7de-68d934bf6612" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-quobyte-ca3c1017-2863-40f4-a7de-68d934bf6612" acquired by "delete_volume" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1ade0d-6400-4e99-8f82-ac5763887452]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ca3c1017-2863-40f4-a7de-68d934bf6612 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:29 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.692s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:10:29 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Deleted volume successfully.
Jul 09 09:10:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dd989dd9-1f95-497a-a4cf-4d733d1affb3 tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-07a31024-f945-442f-a4ac-f54c538a4cd0-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:10:30 devstack sudo[97228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ca3c1017-2863-40f4-a7de-68d934bf6612
Jul 09 09:10:30 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:30 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ca3c1017-2863-40f4-a7de-68d934bf6612" returned: 0 in 0.904s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ca3c1017-2863-40f4-a7de-68d934bf6612 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:30 devstack sudo[97234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ca3c1017-2863-40f4-a7de-68d934bf6612
Jul 09 09:10:30 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:31 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ca3c1017-2863-40f4-a7de-68d934bf6612" returned: 0 in 0.710s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-quobyte-ca3c1017-2863-40f4-a7de-68d934bf6612" released by "delete_volume" :: held 1.674s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:10:31 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Created reservations ['70030406-5835-4c41-bb82-0b89e1582980', '54277764-af71-4b1c-9b32-8c7f86e7ce0b', 'b2278a74-e71c-485b-8bed-318003580184', 'dd513174-323e-4dd8-8cb8-9d6362f2f71d'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:10:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:31 devstack sudo[97237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:10:31 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Flow 'volume_create_manager' (bbdc79dd-fad2-43bf-b832-4d6cc048f431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db852cf-0fa5-4e5c-9482-6f1b2370f522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db852cf-0fa5-4e5c-9482-6f1b2370f522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-587597479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb6dd79-2269-4cfd-843a-6e5fa30251ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c6222df283401caca446fdb53a45de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:33Z,use_quota=True,user_id='ba1d93647a4f45a4ad99cfcbf7e452a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ec5af2-f9f4-4f32-a99b-819e25a498ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ec5af2-f9f4-4f32-a99b-819e25a498ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ae655e-c072-43c1-a44b-c90ec48affd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ae655e-c072-43c1-a44b-c90ec48affd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb6dd79-2269-4cfd-843a-6e5fa30251ec', 'volume_name': 'volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7586d058-53c6-4397-afea-9e820e6a2d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7586d058-53c6-4397-afea-9e820e6a2d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006f31d6-15ed-42bc-ab64-d81415388499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:32 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Volume bdb6dd79-2269-4cfd-843a-6e5fa30251ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec', 'volume_size': 1}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-587597479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb6dd79-2269-4cfd-843a-6e5fa30251ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c6222df283401caca446fdb53a45de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:33Z,use_quota=True,user_id='ba1d93647a4f45a4ad99cfcbf7e452a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Creating volume bdb6dd79-2269-4cfd-843a-6e5fa30251ec {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:10:32 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:10:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:33 devstack sudo[97265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec 1073741824
Jul 09 09:10:33 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:33 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.391s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:33 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:10:33 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Deleted volume successfully.
Jul 09 09:10:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-10a42654-fffa-4c4b-9f01-090ac1ad5b1f tempest-CreateVolumesFromImageTest-577124136 None] Lock "cinder-ca3c1017-2863-40f4-a7de-68d934bf6612-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:10:34 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec 1073741824" returned: 0 in 1.057s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:34 devstack sudo[97271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec
Jul 09 09:10:34 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:34 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec" returned: 0 in 0.765s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:34 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:10:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006f31d6-15ed-42bc-ab64-d81415388499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ef2393-7881-4e95-8be2-5d8c3fc9c0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:34 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Volume volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec (bdb6dd79-2269-4cfd-843a-6e5fa30251ec): created successfully
Jul 09 09:10:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ef2393-7881-4e95-8be2-5d8c3fc9c0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Flow 'volume_create_manager' (bbdc79dd-fad2-43bf-b832-4d6cc048f431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:34 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-cc4b3ef0-5149-42a2-9a5b-a47b32f7a66b tempest-AttachVolumeTestJSON-2089683209 None] Created volume successfully.
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Flow 'volume_create_manager' (3bda865c-a44a-4e3e-9731-34c24876804a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf5df48-140b-4fc0-ba49-2f7fc2eb1584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf5df48-140b-4fc0-ba49-2f7fc2eb1584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2006194430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9190380b02f2476f90eaad923af4efea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:36Z,use_quota=True,user_id='d45b9e3b4298447580bdfa07a2767c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e5fa3e-e3ca-456d-848b-6385c28bd46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e5fa3e-e3ca-456d-848b-6385c28bd46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e151a0-2504-45a5-a801-77a9e604b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e151a0-2504-45a5-a801-77a9e604b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b', 'volume_name': 'volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7f90c5-8102-4f90-9644-84d0e0f43ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7f90c5-8102-4f90-9644-84d0e0f43ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fb7bfa-c798-44e4-beb8-69c244cf8599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:35 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Volume 8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b', 'volume_size': 1}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2006194430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9190380b02f2476f90eaad923af4efea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:36Z,use_quota=True,user_id='d45b9e3b4298447580bdfa07a2767c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Creating volume 8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:10:35 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:10:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:35 devstack sudo[97306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b 1073741824
Jul 09 09:10:35 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:36 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b 1073741824" returned: 0 in 1.048s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:37 devstack sudo[97337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b
Jul 09 09:10:37 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:37 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b" returned: 0 in 0.754s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:10:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fb7bfa-c798-44e4-beb8-69c244cf8599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5e23b3-8450-49b2-a71c-1ea0a55189d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:37 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Volume volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b (8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b): created successfully
Jul 09 09:10:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5e23b3-8450-49b2-a71c-1ea0a55189d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Flow 'volume_create_manager' (3bda865c-a44a-4e3e-9731-34c24876804a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:37 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-4147e204-a3e5-437b-9262-4aa585de2b12 tempest-VolumeDependencyTests-1177202618 None] Created volume successfully.
Jul 09 09:10:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-83071350-460a-4f72-8c88-2f9f4ab83874 req-c21b83dc-5974-4790-9f9c-e9347eb378eb tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-83071350-460a-4f72-8c88-2f9f4ab83874 req-c21b83dc-5974-4790-9f9c-e9347eb378eb tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:39 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b4c8ee-1e0a-4300-a7d6-9cd697243251]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:10:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-83071350-460a-4f72-8c88-2f9f4ab83874 req-c21b83dc-5974-4790-9f9c-e9347eb378eb tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:39 devstack sudo[97374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec
Jul 09 09:10:39 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:40 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-83071350-460a-4f72-8c88-2f9f4ab83874 req-c21b83dc-5974-4790-9f9c-e9347eb378eb tempest-AttachVolumeTestJSON-2089683209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec" returned: 0 in 0.811s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-83071350-460a-4f72-8c88-2f9f4ab83874 req-c21b83dc-5974-4790-9f9c-e9347eb378eb tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.827s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] Creating offline snapshot d0dc4f9c-84a0-4e4a-88bc-c330130de846 of volume 8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:10:40 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c99fa28-4e69-4c10-b6b5-754bd32dee28]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:10:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-83071350-460a-4f72-8c88-2f9f4ab83874 req-c21b83dc-5974-4790-9f9c-e9347eb378eb tempest-AttachVolumeTestJSON-2089683209 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df4872d9-ba5e-4ac5-82a2-335aa0661134', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:10:40 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-83071350-460a-4f72-8c88-2f9f4ab83874 req-c21b83dc-5974-4790-9f9c-e9347eb378eb tempest-AttachVolumeTestJSON-2089683209 None] attachment_update completed successfully.
Jul 09 09:10:40 devstack sudo[97379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b
Jul 09 09:10:40 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6ac0aef5-ba4e-4d45-bfd2-46d7708c5a13 tempest-VolumesActionsTest-1677061414 None] Acquiring lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367" by "attach_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6ac0aef5-ba4e-4d45-bfd2-46d7708c5a13 tempest-VolumesActionsTest-1677061414 None] Lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367" acquired by "attach_volume" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:40 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6ac0aef5-ba4e-4d45-bfd2-46d7708c5a13 tempest-VolumesActionsTest-1677061414 None] Attaching volume 3d715f44-d565-4e4c-9602-4517a6852367 to instance 602b855e-6e90-4d11-8c4d-0106543b5b50 at mountpoint /dev/vdb on host None.
Jul 09 09:10:40 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6ac0aef5-ba4e-4d45-bfd2-46d7708c5a13 tempest-VolumesActionsTest-1677061414 None] Attach volume completed successfully.
Jul 09 09:10:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6ac0aef5-ba4e-4d45-bfd2-46d7708c5a13 tempest-VolumesActionsTest-1677061414 None] Lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367" released by "attach_volume" :: held 0.106s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:10:41 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b" returned: 0 in 1.121s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:41 devstack sudo[97386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846 1G
Jul 09 09:10:41 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9d64452-5026-4b96-a932-4099f30a0f38 tempest-VolumesActionsTest-1677061414 None] Acquiring lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367-detach_volume" by "detach_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9d64452-5026-4b96-a932-4099f30a0f38 tempest-VolumesActionsTest-1677061414 None] Lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:41 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b9d64452-5026-4b96-a932-4099f30a0f38 tempest-VolumesActionsTest-1677061414 None] Detaching volume 3d715f44-d565-4e4c-9602-4517a6852367 from instance 602b855e-6e90-4d11-8c4d-0106543b5b50.
Jul 09 09:10:41 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b9d64452-5026-4b96-a932-4099f30a0f38 tempest-VolumesActionsTest-1677061414 None] Detach volume completed successfully.
Jul 09 09:10:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9d64452-5026-4b96-a932-4099f30a0f38 tempest-VolumesActionsTest-1677061414 None] Lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:10:42 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846 1G" returned: 0 in 1.018s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:42 devstack sudo[97394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846
Jul 09 09:10:42 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:43 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846" returned: 0 in 0.991s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:43 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846 is being set with open permissions: ugo+rw
Jul 09 09:10:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:43 devstack sudo[97417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846
Jul 09 09:10:43 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:43 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-317ff46d-a4dd-4a78-bc32-190f97bc4f27 req-fb551223-eb8a-461b-961d-9c68ff1683e0 tempest-TestShelveInstance-1397742482 None] Terminate volume connection completed successfully.
Jul 09 09:10:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-317ff46d-a4dd-4a78-bc32-190f97bc4f27 req-fb551223-eb8a-461b-961d-9c68ff1683e0 tempest-TestShelveInstance-1397742482 None] Deleting attachment d4f5772a-884c-4f99-af7c-1765a05d16d0. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:10:43 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846" returned: 0 in 0.670s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:44 devstack sudo[97424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.info
Jul 09 09:10:44 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:44 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.info" returned: 0 in 0.792s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:44 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.info is being set with open permissions: ugo+rw
Jul 09 09:10:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:44 devstack sudo[97443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.info
Jul 09 09:10:44 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:45 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.info" returned: 0 in 0.831s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.537s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:45 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6e11a197-c0ad-4d1c-9092-864eb0f1c050 tempest-VolumeDependencyTests-1177202618 None] Create snapshot completed successfully
Jul 09 09:10:46 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-38ffe51f-b8eb-462c-a44c-6f0c6b88528b req-c14aac6f-abd7-4d4f-9a7d-cdbb4627d1cb tempest-AttachVolumeTestJSON-2089683209 None] Terminate volume connection completed successfully.
Jul 09 09:10:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-38ffe51f-b8eb-462c-a44c-6f0c6b88528b req-c14aac6f-abd7-4d4f-9a7d-cdbb4627d1cb tempest-AttachVolumeTestJSON-2089683209 None] Deleting attachment b9f6cf0c-99ca-43ce-b7bc-f5dd6a4331db. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Flow 'volume_create_manager' (d801f082-2f78-45b2-b50e-a7bd2b6373ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ea5917-5bd0-432f-ab20-8292f944c316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ea5917-5bd0-432f-ab20-8292f944c316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-195710606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4571c1ce-7598-4caa-88de-5be787143d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9190380b02f2476f90eaad923af4efea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d0dc4f9c-84a0-4e4a-88bc-c330130de846,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:10:47Z,use_quota=True,user_id='d45b9e3b4298447580bdfa07a2767c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187a3e59-ddb0-47bf-8ae0-e9507aa094b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187a3e59-ddb0-47bf-8ae0-e9507aa094b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c75729-39f8-4ec5-9048-5454daa59046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c75729-39f8-4ec5-9048-5454daa59046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4571c1ce-7598-4caa-88de-5be787143d77', 'volume_name': 'volume-4571c1ce-7598-4caa-88de-5be787143d77', 'volume_size': 1, 'snapshot_id': 'd0dc4f9c-84a0-4e4a-88bc-c330130de846'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d7860d-7dc4-40cc-8dd3-5ae4771738be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d7860d-7dc4-40cc-8dd3-5ae4771738be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f938f157-4c22-4d18-8615-35b6b53582b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:47 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Volume 4571c1ce-7598-4caa-88de-5be787143d77: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4571c1ce-7598-4caa-88de-5be787143d77', 'volume_size': 1, 'snapshot_id': 'd0dc4f9c-84a0-4e4a-88bc-c330130de846'}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "cinder-quobyte-d0dc4f9c-84a0-4e4a-88bc-c330130de846-4571c1ce-7598-4caa-88de-5be787143d77" by "_create_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-quobyte-d0dc4f9c-84a0-4e4a-88bc-c330130de846-4571c1ce-7598-4caa-88de-5be787143d77" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Creating volume 4571c1ce-7598-4caa-88de-5be787143d77 from snapshot d0dc4f9c-84a0-4e4a-88bc-c330130de846 {{(pid=87009) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "cinder-quobyte-4571c1ce-7598-4caa-88de-5be787143d77" by "_copy_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-quobyte-4571c1ce-7598-4caa-88de-5be787143d77" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] snapshot: d0dc4f9c-84a0-4e4a-88bc-c330130de846, volume: 4571c1ce-7598-4caa-88de-5be787143d77,  {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6792e1e9-b64c-43df-a8f0-f700b38a8616]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:10:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:47 devstack sudo[97455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846
Jul 09 09:10:47 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:48 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846" returned: 0 in 0.781s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:10:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] will copy from snapshot at /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 09:10:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Creating direct copy from snapshot {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 09:10:48 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f01046-3409-43eb-936a-ec4c34c65b8d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:10:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:48 devstack sudo[97460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b
Jul 09 09:10:48 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:48 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-c841a340-02ec-4a33-96b3-0d3014f1cff2 req-247971df-8be2-4ae4-bd1a-29699a906210 tempest-AttachVolumeTestJSON-2089683209 None] Terminate volume connection completed successfully.
Jul 09 09:10:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-c841a340-02ec-4a33-96b3-0d3014f1cff2 req-247971df-8be2-4ae4-bd1a-29699a906210 tempest-AttachVolumeTestJSON-2089683209 None] Deleting attachment df4872d9-ba5e-4ac5-82a2-335aa0661134. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:10:49 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b" returned: 0 in 0.847s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:49 devstack cinder-volume[87009]: DEBUG cinder.utils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Path /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77 not found in is_blk_device check {{(pid=87009) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 09:10:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:49 devstack sudo[97470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77
Jul 09 09:10:49 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-d84f6845-f1ad-415d-b739-b40abd46fcdf req-f2ba35b8-dd04-433a-8fb5-69b4b06f120a tempest-TestShelveInstance-1397742482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:10:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:10:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:10:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:10:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:54 devstack sudo[97500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:10:54 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:55 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77" returned: 0 in 6.039s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:55 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[516d7443-4cee-4a13-8543-8f5b69185588]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:10:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:55 devstack sudo[97518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b
Jul 09 09:10:55 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:55 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.470s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:10:55 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:10:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:10:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:10:56 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b" returned: 0 in 1.122s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:56 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Image conversion details: src /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77 {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:10:56 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Converted 1024.00 MB image at 169.49 MB/s
Jul 09 09:10:56 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77 is being set with open permissions: ugo+rw
Jul 09 09:10:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:56 devstack sudo[97528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77
Jul 09 09:10:56 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:57 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77" returned: 0 in 0.699s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-quobyte-4571c1ce-7598-4caa-88de-5be787143d77" released by "_copy_volume_from_snapshot" :: held 9.648s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:10:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-quobyte-d0dc4f9c-84a0-4e4a-88bc-c330130de846-4571c1ce-7598-4caa-88de-5be787143d77" released by "_create_volume_from_snapshot" :: held 9.714s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:10:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.748s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-d84f6845-f1ad-415d-b739-b40abd46fcdf req-f2ba35b8-dd04-433a-8fb5-69b4b06f120a tempest-TestShelveInstance-1397742482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.432s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:10:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f938f157-4c22-4d18-8615-35b6b53582b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4571c1ce-7598-4caa-88de-5be787143d77', 'volume_size': 1, 'snapshot_id': 'd0dc4f9c-84a0-4e4a-88bc-c330130de846'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe83472-53a6-41a5-b2b1-caeffd1d8186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:10:57 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a53cbb-994f-464a-9e0c-c2a224d346ec]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:10:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-d84f6845-f1ad-415d-b739-b40abd46fcdf req-f2ba35b8-dd04-433a-8fb5-69b4b06f120a tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:57 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Volume volume-4571c1ce-7598-4caa-88de-5be787143d77 (4571c1ce-7598-4caa-88de-5be787143d77): created successfully
Jul 09 09:10:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe83472-53a6-41a5-b2b1-caeffd1d8186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:10:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Flow 'volume_create_manager' (d801f082-2f78-45b2-b50e-a7bd2b6373ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:10:57 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-994d3946-2c8e-4e8e-b55d-1ce7b776129d tempest-VolumeDependencyTests-1177202618 None] Created volume successfully.
Jul 09 09:10:57 devstack sudo[97532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934
Jul 09 09:10:57 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:58 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-d84f6845-f1ad-415d-b739-b40abd46fcdf req-f2ba35b8-dd04-433a-8fb5-69b4b06f120a tempest-TestShelveInstance-1397742482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934" returned: 0 in 1.046s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-d84f6845-f1ad-415d-b739-b40abd46fcdf req-f2ba35b8-dd04-433a-8fb5-69b4b06f120a tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "cinder-d0dc4f9c-84a0-4e4a-88bc-c330130de846-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-d0dc4f9c-84a0-4e4a-88bc-c330130de846-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "cinder-quobyte-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-quobyte-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "cinder-quobyte-d0dc4f9c-84a0-4e4a-88bc-c330130de846" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:10:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-quobyte-d0dc4f9c-84a0-4e4a-88bc-c330130de846" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:10:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Deleting offline snapshot d0dc4f9c-84a0-4e4a-88bc-c330130de846 of volume 8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:10:58 devstack sudo[97536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934
Jul 09 09:10:58 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] snapshot_file for this snap is: volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:10:58 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa421d67-41d3-4282-8faf-7dcdc0ec8a5d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:10:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:10:58 devstack sudo[97538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846
Jul 09 09:10:58 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:10:59 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root
Jul 09 09:10:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-d84f6845-f1ad-415d-b739-b40abd46fcdf req-f2ba35b8-dd04-433a-8fb5-69b4b06f120a tempest-TestShelveInstance-1397742482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934" returned: 1 in 1.306s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:10:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-d84f6845-f1ad-415d-b739-b40abd46fcdf req-f2ba35b8-dd04-433a-8fb5-69b4b06f120a tempest-TestShelveInstance-1397742482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:10:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-d84f6845-f1ad-415d-b739-b40abd46fcdf req-f2ba35b8-dd04-433a-8fb5-69b4b06f120a tempest-TestShelveInstance-1397742482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.477s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:10:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-d84f6845-f1ad-415d-b739-b40abd46fcdf req-f2ba35b8-dd04-433a-8fb5-69b4b06f120a tempest-TestShelveInstance-1397742482 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-11c152fc-6003-4bdf-9581-1d6e07d57934', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d7dc0e4-b133-4770-a29f-f83d97d847b0', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:10:59 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-d84f6845-f1ad-415d-b739-b40abd46fcdf req-f2ba35b8-dd04-433a-8fb5-69b4b06f120a tempest-TestShelveInstance-1397742482 None] attachment_update completed successfully.
Jul 09 09:10:59 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846" returned: 0 in 1.394s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:11:00 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[45522079-9433-468e-aa59-eda47df6cf9f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:00 devstack sudo[97561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b
Jul 09 09:11:00 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:00 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b" returned: 0 in 0.820s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:00 devstack sudo[97568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846
Jul 09 09:11:00 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:01 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846" returned: 0 in 0.764s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:01 devstack sudo[97576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846
Jul 09 09:11:01 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:02 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b.d0dc4f9c-84a0-4e4a-88bc-c330130de846" returned: 0 in 0.683s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-quobyte-d0dc4f9c-84a0-4e4a-88bc-c330130de846" released by "_delete_snapshot" :: held 3.817s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-quobyte-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b" released by "delete_snapshot" :: held 3.856s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:02 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Created reservations ['e4645ff3-a691-4820-b87a-5919adfd83b9', '59a7466f-ae2f-4225-958e-95168beeb1c9', '0a407d53-18d5-46c6-a36a-8ee3ea89ace3', '49a875df-34a1-4342-934d-7fe2efa2e392'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:11:02 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Delete snapshot completed successfully.
Jul 09 09:11:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7414cf34-db78-4eda-b789-e292430daff3 tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-d0dc4f9c-84a0-4e4a-88bc-c330130de846-delete_snapshot" released by "delete_snapshot" :: held 4.023s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "cinder-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:11:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:11:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "cinder-quobyte-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:11:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-quobyte-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:11:02 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f648af5f-61bf-4558-bbc8-55c0bfbd9cc5]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:03 devstack sudo[97579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b
Jul 09 09:11:03 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "cinder-bdb6dd79-2269-4cfd-843a-6e5fa30251ec-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:11:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Lock "cinder-bdb6dd79-2269-4cfd-843a-6e5fa30251ec-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:11:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "cinder-quobyte-bdb6dd79-2269-4cfd-843a-6e5fa30251ec" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:11:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Lock "cinder-quobyte-bdb6dd79-2269-4cfd-843a-6e5fa30251ec" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:11:03 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea0b640-997d-45b8-b72a-497c26fac70d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:03 devstack sudo[97584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec
Jul 09 09:11:03 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:04 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b" returned: 0 in 1.205s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:04 devstack sudo[97630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b
Jul 09 09:11:04 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:04 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec" returned: 0 in 1.146s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:04 devstack sudo[97637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec
Jul 09 09:11:04 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:04 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b" returned: 0 in 0.713s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-quobyte-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b" released by "delete_volume" :: held 1.993s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:04 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Created reservations ['ad4ee226-9688-440e-a0bb-3c1d690705c8', '5fce958d-b1ef-4e47-85c7-46a250c24148', '99c651bc-34d8-4945-9572-e670ba4f3bb0', '7889bf0a-aae1-401e-b1c5-a171f23316db'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:05 devstack sudo[97650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:11:05 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:05 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "cinder-4571c1ce-7598-4caa-88de-5be787143d77-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bdb6dd79-2269-4cfd-843a-6e5fa30251ec" returned: 0 in 0.763s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Lock "cinder-quobyte-bdb6dd79-2269-4cfd-843a-6e5fa30251ec" released by "delete_volume" :: held 2.001s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-4571c1ce-7598-4caa-88de-5be787143d77-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "cinder-quobyte-4571c1ce-7598-4caa-88de-5be787143d77" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-quobyte-4571c1ce-7598-4caa-88de-5be787143d77" acquired by "delete_volume" :: waited 0.045s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c49198-0af4-4c56-88b8-0ac3595811b7]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Created reservations ['c591ea86-2c4a-4c94-81e3-2b21eeff43f0', 'ec936366-14b5-4102-af02-57223e9dea36', '5a2d78cd-f390-4db0-9203-b92507b981c3', '412f3e77-f03e-4125-b067-850a5cfb3458'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:11:05 devstack sudo[97663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77
Jul 09 09:11:05 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:11:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:05 devstack sudo[97665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:11:05 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:06 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.301s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:06 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:11:06 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Deleted volume successfully.
Jul 09 09:11:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-47682d23-5d11-4de8-950c-152a16193b14 tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-8ddf28a3-d12a-4e80-9b0d-3c96e8bbdc8b-delete_volume" released by "delete_volume" :: held 3.605s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "cinder-1408f5e5-3ed9-4388-b35f-82f11382eda7-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:11:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Lock "cinder-1408f5e5-3ed9-4388-b35f-82f11382eda7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:11:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "cinder-quobyte-1408f5e5-3ed9-4388-b35f-82f11382eda7" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:11:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Lock "cinder-quobyte-1408f5e5-3ed9-4388-b35f-82f11382eda7" acquired by "delete_volume" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:11:06 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7fa565-1aaf-43c5-9633-0ea5f79bcbda]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:06 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.185s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:06 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:11:06 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Deleted volume successfully.
Jul 09 09:11:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-38658274-68f4-4179-b053-b25ce0e62e03 tempest-AttachVolumeTestJSON-2089683209 None] Lock "cinder-bdb6dd79-2269-4cfd-843a-6e5fa30251ec-delete_volume" released by "delete_volume" :: held 3.646s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:06 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77" returned: 0 in 1.447s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:06 devstack sudo[97676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77
Jul 09 09:11:06 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:06 devstack sudo[97675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7
Jul 09 09:11:06 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:07 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7" returned: 0 in 1.128s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:07 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4571c1ce-7598-4caa-88de-5be787143d77" returned: 0 in 1.073s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:07 devstack sudo[97683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7
Jul 09 09:11:07 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-quobyte-4571c1ce-7598-4caa-88de-5be787143d77" released by "delete_volume" :: held 2.578s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:07 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Created reservations ['cbb1ef72-35d8-407b-8164-9d8dc86a011c', 'f6b20ede-0173-4658-8015-02d09de0c2c4', '102b10a3-c563-42c9-8501-62ae1c46e917', 'c64ba36f-9a5c-4ee7-9494-2b37f088c81f'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:08 devstack sudo[97686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:11:08 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:08 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1408f5e5-3ed9-4388-b35f-82f11382eda7" returned: 0 in 0.862s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Lock "cinder-quobyte-1408f5e5-3ed9-4388-b35f-82f11382eda7" released by "delete_volume" :: held 2.059s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Created reservations ['68198e04-4b0b-4e2e-844e-cd9fbb45c83a', '8629f4ef-3878-4ef7-a0eb-6e99060f54f8', '2d9e0d96-e6da-4999-9f62-cca81706fedb', '94ff7ccc-a77d-422d-bdcc-0acc924458c9'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:11:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:09 devstack sudo[97691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:11:09 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:09 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.052s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:09 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:11:09 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Deleted volume successfully.
Jul 09 09:11:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-825bd21f-a54d-4ee3-bc8c-34718e3dc41b tempest-VolumeDependencyTests-1177202618 None] Lock "cinder-4571c1ce-7598-4caa-88de-5be787143d77-delete_volume" released by "delete_volume" :: held 4.029s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fda8f1bb-c582-4aa3-992d-9be00522f3ab tempest-VolumesActionsTest-1677061414 None] Acquiring lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367" by "attach_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:11:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fda8f1bb-c582-4aa3-992d-9be00522f3ab tempest-VolumesActionsTest-1677061414 None] Lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367" acquired by "attach_volume" :: waited 0.042s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:11:09 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-fda8f1bb-c582-4aa3-992d-9be00522f3ab tempest-VolumesActionsTest-1677061414 None] Attaching volume 3d715f44-d565-4e4c-9602-4517a6852367 to instance 30a996dd-13bd-444c-abe4-f69f10d65f51 at mountpoint /dev/vdb on host None.
Jul 09 09:11:09 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-fda8f1bb-c582-4aa3-992d-9be00522f3ab tempest-VolumesActionsTest-1677061414 None] Attach volume completed successfully.
Jul 09 09:11:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fda8f1bb-c582-4aa3-992d-9be00522f3ab tempest-VolumesActionsTest-1677061414 None] Lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367" released by "attach_volume" :: held 0.220s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:10 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.263s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:10 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:11:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Deleted volume successfully.
Jul 09 09:11:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d9264f23-af78-46b5-8fdb-93eee4c94087 tempest-VolumesActionsTest-1677061414 None] Acquiring lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367-detach_volume" by "detach_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:11:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3209d4ad-5a9c-45f7-8a0b-9cb9eb257524 tempest-AttachVolumeTestJSON-2089683209 None] Lock "cinder-1408f5e5-3ed9-4388-b35f-82f11382eda7-delete_volume" released by "delete_volume" :: held 3.725s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "cinder-d5685b47-376a-47cf-b1b5-e0944bcb46a6-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:11:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d9264f23-af78-46b5-8fdb-93eee4c94087 tempest-VolumesActionsTest-1677061414 None] Lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:11:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d9264f23-af78-46b5-8fdb-93eee4c94087 tempest-VolumesActionsTest-1677061414 None] Detaching volume 3d715f44-d565-4e4c-9602-4517a6852367 from instance 30a996dd-13bd-444c-abe4-f69f10d65f51.
Jul 09 09:11:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Lock "cinder-d5685b47-376a-47cf-b1b5-e0944bcb46a6-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:11:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "cinder-quobyte-d5685b47-376a-47cf-b1b5-e0944bcb46a6" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:11:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d9264f23-af78-46b5-8fdb-93eee4c94087 tempest-VolumesActionsTest-1677061414 None] Detach volume completed successfully.
Jul 09 09:11:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Lock "cinder-quobyte-d5685b47-376a-47cf-b1b5-e0944bcb46a6" acquired by "delete_volume" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:11:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d9264f23-af78-46b5-8fdb-93eee4c94087 tempest-VolumesActionsTest-1677061414 None] Lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367-detach_volume" released by "detach_volume" :: held 0.152s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:10 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0ec0a3-b42f-48ac-a8a1-fccf0ca8bca5]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:10 devstack sudo[97761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6
Jul 09 09:11:10 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:12 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6" returned: 0 in 1.778s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:12 devstack sudo[97811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6
Jul 09 09:11:12 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:13 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d5685b47-376a-47cf-b1b5-e0944bcb46a6" returned: 0 in 0.754s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Lock "cinder-quobyte-d5685b47-376a-47cf-b1b5-e0944bcb46a6" released by "delete_volume" :: held 2.600s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:13 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Created reservations ['e191f8db-0472-439a-a864-077d16f03cda', '8b461653-ecf2-4c43-a25d-0153c1fad3f1', 'e8f5b8ab-00ca-402d-ba8e-14a04ae078a3', 'efa1b7bc-544f-4dd7-8c7c-10d138d428a6'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:11:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:11:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:11:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:11:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:11:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:11:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:13 devstack sudo[98158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:11:13 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:14 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.244s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:14 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:11:14 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Deleted volume successfully.
Jul 09 09:11:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2dacddc6-3c55-4250-8726-b3348a3d78d1 tempest-AttachVolumeTestJSON-2089683209 None] Lock "cinder-d5685b47-376a-47cf-b1b5-e0944bcb46a6-delete_volume" released by "delete_volume" :: held 4.282s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:11:17 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:11:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Flow 'volume_create_manager' (7aa2d054-83cf-4de2-aed5-333e25b92e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:11:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ad3357-316e-4c84-ac0f-d532575a3ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:11:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ad3357-316e-4c84-ac0f-d532575a3ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295a1b7e49a24ee793a439b4bc1a4139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:11:18Z,use_quota=True,user_id='c01a1029132346d88745db4e77481648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:11:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799abe3e-79b1-405d-8941-b9c40cb44740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:11:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799abe3e-79b1-405d-8941-b9c40cb44740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:11:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7ae8e0-f38e-496a-b177-2b15dddf3fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:11:17 devstack cinder-volume[87009]: DEBUG cinder.image.glance [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Creating Keystone auth plugin from conf {{(pid=87009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 09:11:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7ae8e0-f38e-496a-b177-2b15dddf3fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb', 'volume_name': 'volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb', 'volume_size': 1, 'image_id': '906e202d-2c50-4205-b041-b9ab65417ba2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/906e202d-2c50-4205-b041-b9ab65417ba2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f3a451fb23ba4527b4d34b187d124e3d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '295a1b7e49a24ee793a439b4bc1a4139', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e760dc4161f876f0d572444c5c20870dbc84d422cea04c1fc34fd863df7bcc08f5aa75bc17adb987e1fdbc7e919d1c63b97f7a2d6af765dc75d9728dc79af188', 'id': '906e202d-2c50-4205-b041-b9ab65417ba2', 'created_at': datetime.datetime(2026, 7, 9, 7, 11, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 11, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/906e202d-2c50-4205-b041-b9ab65417ba2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a753260>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:11:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0c0c6e-41c4-48a2-ad89-f70f876badbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:11:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0c0c6e-41c4-48a2-ad89-f70f876badbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:11:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11cbf33-213c-4551-95fd-0dee539a049a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:11:18 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Volume 2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb', 'volume_size': 1, 'image_id': '906e202d-2c50-4205-b041-b9ab65417ba2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/906e202d-2c50-4205-b041-b9ab65417ba2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f3a451fb23ba4527b4d34b187d124e3d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '295a1b7e49a24ee793a439b4bc1a4139', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e760dc4161f876f0d572444c5c20870dbc84d422cea04c1fc34fd863df7bcc08f5aa75bc17adb987e1fdbc7e919d1c63b97f7a2d6af765dc75d9728dc79af188', 'id': '906e202d-2c50-4205-b041-b9ab65417ba2', 'created_at': datetime.datetime(2026, 7, 9, 7, 11, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 11, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/906e202d-2c50-4205-b041-b9ab65417ba2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a753260>}
Jul 09 09:11:18 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Trying to clone 2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb from image 906e202d-2c50-4205-b041-b9ab65417ba2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/906e202d-2c50-4205-b041-b9ab65417ba2', 'metadata': {}}]). {{(pid=87009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 09:11:18 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 09:11:18 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Image download 0.00 MB at 0.00 MB/s
Jul 09 09:11:18 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c92f1bb-72b8-437e-b5af-66bf10a26852]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:18 devstack sudo[98173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD
Jul 09 09:11:18 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:19 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD" returned: 0 in 1.161s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:19 devstack sudo[98179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD
Jul 09 09:11:19 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:20 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD" returned: 1 in 0.899s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:11:20 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Temporary image 906e202d-2c50-4205-b041-b9ab65417ba2 is fetched for user c01a1029132346d88745db4e77481648. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 09:11:20 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a241a24-78bf-451b-850d-88ebc75b6d9f]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:20 devstack sudo[98185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD
Jul 09 09:11:20 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:11:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:11:21 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86e874f-240f-481c-87c8-3779bab5229e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:21 devstack sudo[98187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367
Jul 09 09:11:21 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:21 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD" returned: 0 in 1.060s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:21 devstack sudo[98225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD
Jul 09 09:11:21 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:22 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367" returned: 0 in 1.296s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:22 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f830df-69e1-4b64-8941-9e0c729f2bc5]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:22 devstack sudo[98232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367
Jul 09 09:11:22 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:22 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD" returned: 1 in 0.955s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:11:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:11:23 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367" returned: 0 in 0.974s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.580ba441-81f2-4de0-a3ed-d003f4ecb7a34i4gr8eq.img {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:23 devstack sudo[98242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.580ba441-81f2-4de0-a3ed-d003f4ecb7a34i4gr8eq.img
Jul 09 09:11:23 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:29 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.580ba441-81f2-4de0-a3ed-d003f4ecb7a34i4gr8eq.img" returned: 0 in 6.413s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:29 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a33315-45a0-480d-b63f-37c10aee36fc]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:29 devstack sudo[98289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367
Jul 09 09:11:29 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:30 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367" returned: 0 in 0.922s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:30 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] Image conversion details: src /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.580ba441-81f2-4de0-a3ed-d003f4ecb7a34i4gr8eq.img {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:11:30 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] Converted 1024.00 MB image at 159.65 MB/s
Jul 09 09:11:30 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=108,cinder:UPDATE=101,cinder:INSERT=26,cinder:DELETE=5 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:11:30 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=92,cinder:INSERT=27,cinder:UPDATE=115,cinder:DELETE=10 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:11:30 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] 580ba441-81f2-4de0-a3ed-d003f4ecb7a3 was raw, no need to convert to raw {{(pid=87009) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 09 09:11:40 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=1 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:11:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.132s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:11:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] Uploaded volume to glance image-id: 580ba441-81f2-4de0-a3ed-d003f4ecb7a3. {{(pid=87009) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 09 09:11:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.434s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:11:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295a1b7e49a24ee793a439b4bc1a4139',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:11:18Z,use_quota=True,user_id='c01a1029132346d88745db4e77481648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:11:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Creating volume 2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:11:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:11:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:11:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:11:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:11:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:11:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:11:53 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:11:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:53 devstack sudo[98398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb 1073741824
Jul 09 09:11:53 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:53 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-8e3b5503-a551-4ff8-86e2-31fbb2616a4e tempest-VolumesActionsTest-1677061414 None] Copy volume to image completed successfully.
Jul 09 09:11:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:11:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:11:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:11:54 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb 1073741824" returned: 0 in 1.384s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:54 devstack sudo[98408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb
Jul 09 09:11:54 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:55 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb" returned: 0 in 1.027s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] <== create_volume: return (2489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:11:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.493s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:11:55 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Attempting download of 906e202d-2c50-4205-b041-b9ab65417ba2 ((None, [{'url': 'file:///opt/stack/data/glance/images/906e202d-2c50-4205-b041-b9ab65417ba2', 'metadata': {}}])) to volume 2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 09:11:55 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbbea87-04d8-4120-8c6c-4828b185372a]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_906e202d-2c50-4205-b041-b9ab65417ba2_2g2aiamn {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:55 devstack sudo[98428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_906e202d-2c50-4205-b041-b9ab65417ba2_2g2aiamn
Jul 09 09:11:55 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:11:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:11:56 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c4f90f-f7ed-40ef-802d-b3852d43e5fa]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:56 devstack sudo[98430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367
Jul 09 09:11:56 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:57 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_906e202d-2c50-4205-b041-b9ab65417ba2_2g2aiamn" returned: 0 in 1.379s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_906e202d-2c50-4205-b041-b9ab65417ba2_2g2aiamn {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:57 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367" returned: 0 in 1.278s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:57 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cd68b3-ae28-4005-8442-a36d0f00bffc]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:57 devstack sudo[98441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_906e202d-2c50-4205-b041-b9ab65417ba2_2g2aiamn
Jul 09 09:11:57 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:57 devstack sudo[98447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367
Jul 09 09:11:57 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:57 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-d87cd0a9-8c19-41f7-8785-b1441c1e04b4 tempest-TestShelveInstance-1397742482 None] Terminate volume connection completed successfully.
Jul 09 09:11:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-d87cd0a9-8c19-41f7-8785-b1441c1e04b4 tempest-TestShelveInstance-1397742482 None] Deleting attachment 3d7dc0e4-b133-4770-a29f-f83d97d847b0. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:11:58 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_906e202d-2c50-4205-b041-b9ab65417ba2_2g2aiamn" returned: 1 in 1.079s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_906e202d-2c50-4205-b041-b9ab65417ba2_2g2aiamn' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:11:58 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8881d145-00a8-42b5-92d6-8c05ca198d36]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:58 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root
Jul 09 09:11:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367" returned: 0 in 0.928s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:11:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:58 devstack sudo[98461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img
Jul 09 09:11:58 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:58 devstack sudo[98460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD
Jul 09 09:11:58 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Acquiring lock "cinder-11c152fc-6003-4bdf-9581-1d6e07d57934-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:11:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Lock "cinder-11c152fc-6003-4bdf-9581-1d6e07d57934-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:11:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Acquiring lock "cinder-quobyte-11c152fc-6003-4bdf-9581-1d6e07d57934" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:11:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Lock "cinder-quobyte-11c152fc-6003-4bdf-9581-1d6e07d57934" acquired by "delete_volume" :: waited 0.038s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:11:59 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea2cb27-a893-4a68-9302-7d33de1b35fa]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:11:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:11:59 devstack sudo[98465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934
Jul 09 09:11:59 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:11:59 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD" returned: 0 in 1.729s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:00 devstack sudo[98479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD
Jul 09 09:12:00 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:01 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934" returned: 0 in 2.305s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:01 devstack sudo[98483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934
Jul 09 09:12:01 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:02 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD" returned: 1 in 2.179s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:12:02 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] 906e202d-2c50-4205-b041-b9ab65417ba2 was raw, converting to raw {{(pid=87009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 09:12:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:02 devstack sudo[98488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb
Jul 09 09:12:02 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:03 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934" returned: 1 in 2.532s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:12:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:03 devstack sudo[98493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934
Jul 09 09:12:03 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:04 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb" returned: 0 in 2.739s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:04 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_906e202d-2c50-4205-b041-b9ab65417ba2_jioqa4mvdevstack@QuobyteHD, size 0.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:12:04 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Converted 0.00 MB image at 0.00 MB/s
Jul 09 09:12:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:05 devstack sudo[98512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb 1G
Jul 09 09:12:05 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:05 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-11c152fc-6003-4bdf-9581-1d6e07d57934" returned: 0 in 1.327s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Lock "cinder-quobyte-11c152fc-6003-4bdf-9581-1d6e07d57934" released by "delete_volume" :: held 6.317s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:12:05 devstack cinder-volume[87009]: DEBUG cinder.quota [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Created reservations ['5b3d514b-d216-487d-b27c-723ca191ceae', '4404d0ed-eb19-410d-8528-ee2bceb6f1fc', 'bd975c64-d8fd-41ba-82bb-05da0ba6ae97', 'bcef1e53-77d6-497a-afda-9a3c6be96e7b'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:12:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:12:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:12:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:05 devstack sudo[98515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:12:05 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:06 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img" returned: 0 in 8.116s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:06 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d400faa5-1f04-48a5-bb49-6afb0a92fa0c]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:12:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:06 devstack sudo[98520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367
Jul 09 09:12:06 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:06 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb 1G" returned: 0 in 1.647s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:06 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee92333-5cbc-479c-bcf6-61eab7241447]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:12:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:06 devstack sudo[98522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb
Jul 09 09:12:06 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:06 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.220s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:06 devstack cinder-volume[87009]: DEBUG cinder.manager [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:12:06 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Deleted volume successfully.
Jul 09 09:12:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [req-3edc0021-64a5-41c8-a747-7fa2de5b4cf9 req-7459d928-140c-4900-93c0-1153265b0932 tempest-TestShelveInstance-1397742482 None] Lock "cinder-11c152fc-6003-4bdf-9581-1d6e07d57934-delete_volume" released by "delete_volume" :: held 8.108s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:12:07 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb" returned: 0 in 0.833s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:07 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367" returned: 0 in 1.173s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:07 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Image conversion details: src /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367, size 1024.00 MB, duration 8.12 sec, destination /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:12:07 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Converted 1024.00 MB image at 126.16 MB/s
Jul 09 09:12:07 devstack sudo[98531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb
Jul 09 09:12:07 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:07 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] 1d060252-4d18-4739-8dde-eb946b9d11a2 was raw, converting to qcow2 {{(pid=87009) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 09 09:12:07 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa534659-8f68-4d3c-91a5-85c3d6d9c9f8]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:12:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:07 devstack sudo[98533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img
Jul 09 09:12:07 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:08 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb" returned: 1 in 0.814s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:12:08 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Downloaded image 906e202d-2c50-4205-b041-b9ab65417ba2 ((None, [{'url': 'file:///opt/stack/data/glance/images/906e202d-2c50-4205-b041-b9ab65417ba2', 'metadata': {}}])) to volume 2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb successfully. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 09:12:08 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Temporary image 906e202d-2c50-4205-b041-b9ab65417ba2 for user c01a1029132346d88745db4e77481648 is deleted. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 09:12:08 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Marking volume 2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb as bootable. {{(pid=87009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 09:12:08 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Copying metadata from image 906e202d-2c50-4205-b041-b9ab65417ba2 to 2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb. {{(pid=87009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 09:12:08 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Creating volume glance metadata for volume 2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb backed by image 906e202d-2c50-4205-b041-b9ab65417ba2 with: {'image_id': '906e202d-2c50-4205-b041-b9ab65417ba2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f3a451fb23ba4527b4d34b187d124e3d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 09:12:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11cbf33-213c-4551-95fd-0dee539a049a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb', 'volume_size': 1, 'image_id': '906e202d-2c50-4205-b041-b9ab65417ba2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/906e202d-2c50-4205-b041-b9ab65417ba2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f3a451fb23ba4527b4d34b187d124e3d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '295a1b7e49a24ee793a439b4bc1a4139', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e760dc4161f876f0d572444c5c20870dbc84d422cea04c1fc34fd863df7bcc08f5aa75bc17adb987e1fdbc7e919d1c63b97f7a2d6af765dc75d9728dc79af188', 'id': '906e202d-2c50-4205-b041-b9ab65417ba2', 'created_at': datetime.datetime(2026, 7, 9, 7, 11, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 11, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/906e202d-2c50-4205-b041-b9ab65417ba2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a753260>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:08 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aaf4d9b-47ff-49e9-9fb0-b2606e9991a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img" returned: 0 in 0.756s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:08 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Volume volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb (2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb): created successfully
Jul 09 09:12:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aaf4d9b-47ff-49e9-9fb0-b2606e9991a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Flow 'volume_create_manager' (7aa2d054-83cf-4de2-aed5-333e25b92e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:08 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-21d121a6-3eec-4fb8-a88d-efc8ad20ba24 tempest-VolumeImageDependencyTests-1967462442 None] Created volume successfully.
Jul 09 09:12:08 devstack sudo[98541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img
Jul 09 09:12:08 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:09 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img" returned: 1 in 0.832s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:12:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img /opt/stack/data/cinder/conversion/vol_upload_ow057gel {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:09 devstack sudo[98547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img /opt/stack/data/cinder/conversion/vol_upload_ow057gel
Jul 09 09:12:09 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Acquiring lock "cinder-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:12:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Lock "cinder-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:12:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Acquiring lock "cinder-quobyte-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:12:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Lock "cinder-quobyte-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb" acquired by "delete_volume" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:12:09 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5450d8-9232-43f0-a710-b7ced0ca338d]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:12:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:09 devstack sudo[98549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb
Jul 09 09:12:09 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:10 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img /opt/stack/data/cinder/conversion/vol_upload_ow057gel" returned: 0 in 0.865s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:10 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Image conversion details: src /opt/stack/data/cinder/conversion/3d715f44-d565-4e4c-9602-4517a6852367.temp_image.1d060252-4d18-4739-8dde-eb946b9d11a2uijte57d.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ow057gel {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:12:10 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 09 09:12:10 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[777e6534-1f9c-49aa-8e7b-469db1170a01]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:12:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ow057gel {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:10 devstack sudo[98555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ow057gel
Jul 09 09:12:10 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:10 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb" returned: 0 in 0.867s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:10 devstack sudo[98559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb
Jul 09 09:12:10 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:10 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ow057gel" returned: 0 in 0.809s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:11 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb" returned: 1 in 0.828s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:12:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:11 devstack sudo[98567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb
Jul 09 09:12:11 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:12 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb" returned: 0 in 0.908s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Lock "cinder-quobyte-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb" released by "delete_volume" :: held 2.716s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:12:12 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Created reservations ['861ab5ff-4122-4129-beba-a3988f0a1a4e', '5f10fbee-7c8a-42f7-82c8-34e2dbbd5e12', '8e316321-6b9a-4d61-9be8-bdf631246184', '339d0c0a-b278-44ae-8fe2-b672a6fdbbd2'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:12:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:12:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:12:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:12 devstack sudo[98571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:12:12 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.741s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Uploaded volume to glance image-id: 1d060252-4d18-4739-8dde-eb946b9d11a2. {{(pid=87009) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 09 09:12:12 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-41505831-9b0d-43f7-94a5-10777685b294 tempest-VolumesActionsTest-1677061414 None] Copy volume to image completed successfully.
Jul 09 09:12:13 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.224s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:13 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:12:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Deleted volume successfully.
Jul 09 09:12:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-639a4570-b705-44f9-9372-7b4148bd7fce tempest-VolumeImageDependencyTests-1967462442 None] Lock "cinder-2ff4e78c-73bb-43fc-871d-bbd5ca1f78cb-delete_volume" released by "delete_volume" :: held 4.267s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:12:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Acquiring lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:12:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:12:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Acquiring lock "cinder-quobyte-3d715f44-d565-4e4c-9602-4517a6852367" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:12:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Lock "cinder-quobyte-3d715f44-d565-4e4c-9602-4517a6852367" acquired by "delete_volume" :: waited 0.039s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:12:14 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4b810c-2b68-4642-aff1-08b17e721791]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:12:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:14 devstack sudo[98575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367
Jul 09 09:12:14 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:15 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367" returned: 0 in 0.836s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:15 devstack sudo[98580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367
Jul 09 09:12:15 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:15 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3d715f44-d565-4e4c-9602-4517a6852367" returned: 0 in 0.733s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:15 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Lock "cinder-quobyte-3d715f44-d565-4e4c-9602-4517a6852367" released by "delete_volume" :: held 1.617s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:12:15 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Created reservations ['6e7fa6ce-6fae-4943-b26a-f1abaaac7c38', '92b16392-6104-450d-b8e3-a6b82920aee2', '9fbcbe1a-592f-432a-88d2-9fe5c0b29035', '156dc1ad-41b2-4fd0-92a1-8054bb57f6df'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:12:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:12:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:12:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:15 devstack sudo[98583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:12:15 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:16 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.691s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:16 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:12:16 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Deleted volume successfully.
Jul 09 09:12:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a174dd7b-0b1e-4633-b2f8-ca66952c9b8c tempest-VolumesActionsTest-1677061414 None] Lock "cinder-3d715f44-d565-4e4c-9602-4517a6852367-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Flow 'volume_create_manager' (931cfe8a-cc7d-46a3-9b3e-cbd0b446c1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e84c992-4158-4df9-8002-b56d7ab0fc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e84c992-4158-4df9-8002-b56d7ab0fc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-64230978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b77ec4-d64c-46b4-b05d-fdec8159a7aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b64a5cbb4a4d56af35faa17ec46ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:17Z,use_quota=True,user_id='a95a30c3a47341a085f87b33c7ef514c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325c4b5f-e4d5-4593-a1f6-6c0867bc6eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325c4b5f-e4d5-4593-a1f6-6c0867bc6eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f57f0a5-a5ec-4032-b246-21d9b3c8b848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f57f0a5-a5ec-4032-b246-21d9b3c8b848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b77ec4-d64c-46b4-b05d-fdec8159a7aa', 'volume_name': 'volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44102c1-6dd3-483f-8d4c-3cc7bebbe18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44102c1-6dd3-483f-8d4c-3cc7bebbe18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629a252d-da25-4d26-b985-05705f4e52fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:17 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Volume c7b77ec4-d64c-46b4-b05d-fdec8159a7aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa', 'volume_size': 1}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-64230978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b77ec4-d64c-46b4-b05d-fdec8159a7aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b64a5cbb4a4d56af35faa17ec46ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:17Z,use_quota=True,user_id='a95a30c3a47341a085f87b33c7ef514c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Creating volume c7b77ec4-d64c-46b4-b05d-fdec8159a7aa {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:12:17 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:12:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:17 devstack sudo[98588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa 1073741824
Jul 09 09:12:17 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:18 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa 1073741824" returned: 0 in 0.936s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:18 devstack sudo[98595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa
Jul 09 09:12:18 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:19 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa" returned: 0 in 0.693s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:12:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (629a252d-da25-4d26-b985-05705f4e52fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6239f6c-b7f7-456c-82d3-bcedaa210267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:19 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Volume volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa (c7b77ec4-d64c-46b4-b05d-fdec8159a7aa): created successfully
Jul 09 09:12:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6239f6c-b7f7-456c-82d3-bcedaa210267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Flow 'volume_create_manager' (931cfe8a-cc7d-46a3-9b3e-cbd0b446c1ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:19 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e1936cc2-b2c8-453c-b8af-9d2bbc2dc2b0 tempest-AttachVolumeNegativeTest-1492218879 None] Created volume successfully.
Jul 09 09:12:21 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:12:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Flow 'volume_create_manager' (63f3665b-9699-401a-92e8-3f47effa9f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c4d275-fa24-4277-8c83-ab51434f3c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c4d275-fa24-4277-8c83-ab51434f3c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a28391-7c79-48f1-8f70-5282789aa19a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29c30ed2f6044eb9f15ddf4ef5f31f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:22Z,use_quota=True,user_id='297e8827d2e54f3a813210d1e86a49ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d939b-f2de-4879-b116-646d68c39421),volume_type_id=370d939b-f2de-4879-b116-646d68c39421)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e646c8c7-8801-481a-8f88-6003f3757378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e646c8c7-8801-481a-8f88-6003f3757378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e452be0-138c-48a6-b00e-01c5fa60b3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:21 devstack cinder-volume[87009]: DEBUG cinder.image.glance [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Creating Keystone auth plugin from conf {{(pid=87009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 09:12:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e452be0-138c-48a6-b00e-01c5fa60b3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '39a28391-7c79-48f1-8f70-5282789aa19a', 'volume_name': 'volume-39a28391-7c79-48f1-8f70-5282789aa19a', 'volume_size': 1, 'image_id': '7e95c74e-b342-4f1c-86f5-fc483421d6c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e95c74e-b342-4f1c-86f5-fc483421d6c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fab7162aafabc1fd806c3454b375789', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b29c30ed2f6044eb9f15ddf4ef5f31f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3c22f40def00d8d4c7263586a95f04ff37666d04ff063bfb06743e72305bbac1cb45732e01e9207df93cc6d84f6edf326f37ef62cbe5bf8c49e05923fe1e2f05', 'id': '7e95c74e-b342-4f1c-86f5-fc483421d6c7', 'created_at': datetime.datetime(2026, 7, 9, 7, 12, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 12, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e95c74e-b342-4f1c-86f5-fc483421d6c7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59afd0290>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16411163-d4c4-45ac-b7f8-840cf5699ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16411163-d4c4-45ac-b7f8-840cf5699ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686f5ac8-2d40-47d3-8337-4611b7da2130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:22 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Volume 39a28391-7c79-48f1-8f70-5282789aa19a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-39a28391-7c79-48f1-8f70-5282789aa19a', 'volume_size': 1, 'image_id': '7e95c74e-b342-4f1c-86f5-fc483421d6c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e95c74e-b342-4f1c-86f5-fc483421d6c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fab7162aafabc1fd806c3454b375789', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b29c30ed2f6044eb9f15ddf4ef5f31f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3c22f40def00d8d4c7263586a95f04ff37666d04ff063bfb06743e72305bbac1cb45732e01e9207df93cc6d84f6edf326f37ef62cbe5bf8c49e05923fe1e2f05', 'id': '7e95c74e-b342-4f1c-86f5-fc483421d6c7', 'created_at': datetime.datetime(2026, 7, 9, 7, 12, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 12, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e95c74e-b342-4f1c-86f5-fc483421d6c7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59afd0290>}
Jul 09 09:12:22 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Trying to clone 39a28391-7c79-48f1-8f70-5282789aa19a from image 7e95c74e-b342-4f1c-86f5-fc483421d6c7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7e95c74e-b342-4f1c-86f5-fc483421d6c7', 'metadata': {}}]). {{(pid=87009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 09:12:22 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 09:12:22 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Image download 0.00 MB at 0.00 MB/s
Jul 09 09:12:22 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5469b436-25b1-4e8f-9e68-d55986d431d6]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:12:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:22 devstack sudo[98604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD
Jul 09 09:12:22 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-2b3cb7c4-3723-4603-8626-585175839bdb req-849b55a1-63b4-4120-8399-80f90faea62b tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-2b3cb7c4-3723-4603-8626-585175839bdb req-849b55a1-63b4-4120-8399-80f90faea62b tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:22 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5d4561-445d-4d87-8ed3-16f635cd9e69]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:12:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-2b3cb7c4-3723-4603-8626-585175839bdb req-849b55a1-63b4-4120-8399-80f90faea62b tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:22 devstack sudo[98652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa
Jul 09 09:12:22 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:23 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD" returned: 0 in 0.891s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:23 devstack sudo[98656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD
Jul 09 09:12:23 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:23 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-2b3cb7c4-3723-4603-8626-585175839bdb req-849b55a1-63b4-4120-8399-80f90faea62b tempest-AttachVolumeNegativeTest-1492218879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa" returned: 0 in 0.837s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-2b3cb7c4-3723-4603-8626-585175839bdb req-849b55a1-63b4-4120-8399-80f90faea62b tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.862s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-2b3cb7c4-3723-4603-8626-585175839bdb req-849b55a1-63b4-4120-8399-80f90faea62b tempest-AttachVolumeNegativeTest-1492218879 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9930cf74-659a-4d72-b23a-eceed92ad349', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:12:23 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-2b3cb7c4-3723-4603-8626-585175839bdb req-849b55a1-63b4-4120-8399-80f90faea62b tempest-AttachVolumeNegativeTest-1492218879 None] attachment_update completed successfully.
Jul 09 09:12:23 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD" returned: 1 in 0.780s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:12:23 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Temporary image 7e95c74e-b342-4f1c-86f5-fc483421d6c7 is fetched for user 297e8827d2e54f3a813210d1e86a49ef. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 09:12:23 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[202e963e-8a2b-4112-ae5a-ba752ce0c40d]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:12:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:24 devstack sudo[98664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD
Jul 09 09:12:24 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:24 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:24 devstack sudo[98735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD
Jul 09 09:12:24 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:25 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD" returned: 1 in 0.804s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:12:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a28391-7c79-48f1-8f70-5282789aa19a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29c30ed2f6044eb9f15ddf4ef5f31f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:22Z,use_quota=True,user_id='297e8827d2e54f3a813210d1e86a49ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d939b-f2de-4879-b116-646d68c39421),volume_type_id=370d939b-f2de-4879-b116-646d68c39421)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:12:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Creating volume 39a28391-7c79-48f1-8f70-5282789aa19a {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:12:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:12:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:12:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:12:25 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:12:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:25 devstack sudo[99056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a 1073741824
Jul 09 09:12:25 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:26 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a 1073741824" returned: 0 in 0.895s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:26 devstack sudo[99062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a
Jul 09 09:12:26 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:27 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a" returned: 0 in 0.706s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:12:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:27 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Attempting download of 7e95c74e-b342-4f1c-86f5-fc483421d6c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7e95c74e-b342-4f1c-86f5-fc483421d6c7', 'metadata': {}}])) to volume 39a28391-7c79-48f1-8f70-5282789aa19a. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 09:12:27 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee35bdb-35b2-4b4e-a8ed-fd9ca81ed994]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:12:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e95c74e-b342-4f1c-86f5-fc483421d6c7_ecarto7v {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:27 devstack sudo[99065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e95c74e-b342-4f1c-86f5-fc483421d6c7_ecarto7v
Jul 09 09:12:27 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:28 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e95c74e-b342-4f1c-86f5-fc483421d6c7_ecarto7v" returned: 0 in 0.751s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e95c74e-b342-4f1c-86f5-fc483421d6c7_ecarto7v {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:28 devstack sudo[99069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e95c74e-b342-4f1c-86f5-fc483421d6c7_ecarto7v
Jul 09 09:12:28 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:28 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e95c74e-b342-4f1c-86f5-fc483421d6c7_ecarto7v" returned: 1 in 0.855s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e95c74e-b342-4f1c-86f5-fc483421d6c7_ecarto7v' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:12:28 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2c35fb-84fe-4840-a9bc-ba7f368c1384]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:12:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:29 devstack sudo[99073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD
Jul 09 09:12:29 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:29 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD" returned: 0 in 0.838s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:29 devstack sudo[99078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD
Jul 09 09:12:29 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:30 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD" returned: 1 in 0.866s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:12:30 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] 7e95c74e-b342-4f1c-86f5-fc483421d6c7 was raw, converting to raw {{(pid=87009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 09:12:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:30 devstack sudo[99083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a
Jul 09 09:12:30 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:31 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a" returned: 0 in 0.947s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:31 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7e95c74e-b342-4f1c-86f5-fc483421d6c7_m6umdkdwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:12:31 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Converted 0.00 MB image at 0.00 MB/s
Jul 09 09:12:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:31 devstack sudo[99088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a 1G
Jul 09 09:12:31 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:32 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a 1G" returned: 0 in 0.843s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:32 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3362cdf7-5a35-4af9-82f6-aa5ff13a4f32]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:12:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:32 devstack sudo[99096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a
Jul 09 09:12:32 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:33 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a" returned: 0 in 0.877s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:33 devstack sudo[99106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a
Jul 09 09:12:33 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:34 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a" returned: 1 in 0.934s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Downloaded image 7e95c74e-b342-4f1c-86f5-fc483421d6c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/7e95c74e-b342-4f1c-86f5-fc483421d6c7', 'metadata': {}}])) to volume 39a28391-7c79-48f1-8f70-5282789aa19a successfully. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Temporary image 7e95c74e-b342-4f1c-86f5-fc483421d6c7 for user 297e8827d2e54f3a813210d1e86a49ef is deleted. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Marking volume 39a28391-7c79-48f1-8f70-5282789aa19a as bootable. {{(pid=87009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Copying metadata from image 7e95c74e-b342-4f1c-86f5-fc483421d6c7 to 39a28391-7c79-48f1-8f70-5282789aa19a. {{(pid=87009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Creating volume glance metadata for volume 39a28391-7c79-48f1-8f70-5282789aa19a backed by image 7e95c74e-b342-4f1c-86f5-fc483421d6c7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7e95c74e-b342-4f1c-86f5-fc483421d6c7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5fab7162aafabc1fd806c3454b375789', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686f5ac8-2d40-47d3-8337-4611b7da2130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a28391-7c79-48f1-8f70-5282789aa19a', 'volume_size': 1, 'image_id': '7e95c74e-b342-4f1c-86f5-fc483421d6c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e95c74e-b342-4f1c-86f5-fc483421d6c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5fab7162aafabc1fd806c3454b375789', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b29c30ed2f6044eb9f15ddf4ef5f31f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3c22f40def00d8d4c7263586a95f04ff37666d04ff063bfb06743e72305bbac1cb45732e01e9207df93cc6d84f6edf326f37ef62cbe5bf8c49e05923fe1e2f05', 'id': '7e95c74e-b342-4f1c-86f5-fc483421d6c7', 'created_at': datetime.datetime(2026, 7, 9, 7, 12, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 12, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e95c74e-b342-4f1c-86f5-fc483421d6c7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59afd0290>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9bccb2-d96e-4baa-9d33-fec8da1cf33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:34 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Volume volume-39a28391-7c79-48f1-8f70-5282789aa19a (39a28391-7c79-48f1-8f70-5282789aa19a): created successfully
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9bccb2-d96e-4baa-9d33-fec8da1cf33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Flow 'volume_create_manager' (63f3665b-9699-401a-92e8-3f47effa9f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:34 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2c01de6e-faad-4581-9b36-4870dc6794a2 tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Created volume successfully.
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Acquiring lock "cinder-39a28391-7c79-48f1-8f70-5282789aa19a-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Lock "cinder-39a28391-7c79-48f1-8f70-5282789aa19a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Acquiring lock "cinder-quobyte-39a28391-7c79-48f1-8f70-5282789aa19a" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Lock "cinder-quobyte-39a28391-7c79-48f1-8f70-5282789aa19a" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a262c9-5550-47fd-a130-93f99ebd3c6c]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:12:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:34 devstack sudo[99112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a
Jul 09 09:12:34 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:35 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a" returned: 0 in 0.810s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:35 devstack sudo[99116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a
Jul 09 09:12:35 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:36 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a" returned: 1 in 0.819s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:12:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:36 devstack sudo[99121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a
Jul 09 09:12:36 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:37 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-39a28391-7c79-48f1-8f70-5282789aa19a" returned: 0 in 0.720s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Lock "cinder-quobyte-39a28391-7c79-48f1-8f70-5282789aa19a" released by "delete_volume" :: held 2.419s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:12:37 devstack cinder-volume[87009]: WARNING cinder.quota [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:12:37 devstack cinder-volume[87009]: WARNING cinder.quota [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 09 09:12:37 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Created reservations ['b90053b7-c066-4174-bed9-ecb6ea398c3a', '6bdbd01b-ef94-4f86-8a9a-88dfc3642d92', '1ef88f7a-f5b7-4992-adf2-9db407526ff7', 'fb0e3102-cd34-4293-9dc8-51dd21288cc1'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:12:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:12:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:12:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:37 devstack sudo[99124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:12:37 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:38 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.898s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:38 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:12:38 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Deleted volume successfully.
Jul 09 09:12:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-6e94ad17-3ced-4dc7-a25d-01164c80657b tempest-VolumeAndVolumeTypeFromImageTest-388356984 None] Lock "cinder-39a28391-7c79-48f1-8f70-5282789aa19a-delete_volume" released by "delete_volume" :: held 3.589s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=50,cinder:UPDATE=45,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Flow 'volume_create_manager' (1faca348-e303-4be5-91e9-ee1d3a38108d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96380cb-f02e-43d8-8992-22f07e99387d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96380cb-f02e-43d8-8992-22f07e99387d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-299285630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7579708-b349-4836-8e3d-7903640f298f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e07a42db8245bab6ea15a24a0d3113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:45Z,use_quota=True,user_id='5e2f23f429e34829a4f5d6fe9aa45ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e6f319-16e7-42b5-b01e-00934559828e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e6f319-16e7-42b5-b01e-00934559828e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5fc5370-c29e-4ade-b9a3-577ac4b95384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5fc5370-c29e-4ade-b9a3-577ac4b95384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7579708-b349-4836-8e3d-7903640f298f', 'volume_name': 'volume-a7579708-b349-4836-8e3d-7903640f298f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9e5691-8f92-4898-9cdd-b3fecea80970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9e5691-8f92-4898-9cdd-b3fecea80970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01932f72-5e8f-4dad-b8b3-f56824d1dcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:45 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume a7579708-b349-4836-8e3d-7903640f298f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7579708-b349-4836-8e3d-7903640f298f', 'volume_size': 1}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-299285630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7579708-b349-4836-8e3d-7903640f298f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e07a42db8245bab6ea15a24a0d3113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:45Z,use_quota=True,user_id='5e2f23f429e34829a4f5d6fe9aa45ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Creating volume a7579708-b349-4836-8e3d-7903640f298f {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:12:45 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:12:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7579708-b349-4836-8e3d-7903640f298f 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:45 devstack sudo[99187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7579708-b349-4836-8e3d-7903640f298f 1073741824
Jul 09 09:12:45 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:46 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7579708-b349-4836-8e3d-7903640f298f 1073741824" returned: 0 in 0.954s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7579708-b349-4836-8e3d-7903640f298f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:46 devstack sudo[99213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7579708-b349-4836-8e3d-7903640f298f
Jul 09 09:12:46 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:47 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7579708-b349-4836-8e3d-7903640f298f" returned: 0 in 0.712s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01932f72-5e8f-4dad-b8b3-f56824d1dcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7579708-b349-4836-8e3d-7903640f298f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285d691e-eb48-4234-953a-10f8d74b34a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:47 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume volume-a7579708-b349-4836-8e3d-7903640f298f (a7579708-b349-4836-8e3d-7903640f298f): created successfully
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285d691e-eb48-4234-953a-10f8d74b34a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Flow 'volume_create_manager' (1faca348-e303-4be5-91e9-ee1d3a38108d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:47 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2044b040-9b78-4b41-8a04-9d0c235c785e tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Created volume successfully.
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Flow 'volume_create_manager' (3e43d2b9-337f-4709-91d7-ae355457966f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0954da44-7a5a-4240-83b3-60fada7db23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0954da44-7a5a-4240-83b3-60fada7db23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1413945676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4002e9d-3008-4def-bf81-1ec9cbd21d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e07a42db8245bab6ea15a24a0d3113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:48Z,use_quota=True,user_id='5e2f23f429e34829a4f5d6fe9aa45ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b440d2b-870e-4931-9fc7-95e9fc8893cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b440d2b-870e-4931-9fc7-95e9fc8893cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92129d3f-d0c5-4568-b664-ec4914c6c8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92129d3f-d0c5-4568-b664-ec4914c6c8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4002e9d-3008-4def-bf81-1ec9cbd21d04', 'volume_name': 'volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffc9ac5-a23e-445c-b245-9a1fb1a39121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffc9ac5-a23e-445c-b245-9a1fb1a39121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e546fd0-6251-432a-8319-f0acfd8f1226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:48 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume f4002e9d-3008-4def-bf81-1ec9cbd21d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04', 'volume_size': 1}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1413945676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4002e9d-3008-4def-bf81-1ec9cbd21d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e07a42db8245bab6ea15a24a0d3113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:48Z,use_quota=True,user_id='5e2f23f429e34829a4f5d6fe9aa45ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Creating volume f4002e9d-3008-4def-bf81-1ec9cbd21d04 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:12:48 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:48 devstack sudo[99219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04 1073741824
Jul 09 09:12:48 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Flow 'volume_create_manager' (68babffd-ab7f-42fa-ac5f-fe6c6fd39777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bffbe4-df0e-4e98-ae19-386896fd0d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bffbe4-df0e-4e98-ae19-386896fd0d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1492799027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433d4eac-5092-4cc7-949a-080763fef0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e07a42db8245bab6ea15a24a0d3113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:48Z,use_quota=True,user_id='5e2f23f429e34829a4f5d6fe9aa45ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff502a77-3f41-4b69-9259-8500fb883aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff502a77-3f41-4b69-9259-8500fb883aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f0830e-f7c9-4341-b2bf-e8106fc27cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f0830e-f7c9-4341-b2bf-e8106fc27cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '433d4eac-5092-4cc7-949a-080763fef0aa', 'volume_name': 'volume-433d4eac-5092-4cc7-949a-080763fef0aa', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e125bf7-8bb5-43d4-8d28-d8c5eb25f202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e125bf7-8bb5-43d4-8d28-d8c5eb25f202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e0afb5-b3e0-4af9-9a3e-af9276e5ee20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:48 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume 433d4eac-5092-4cc7-949a-080763fef0aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-433d4eac-5092-4cc7-949a-080763fef0aa', 'volume_size': 1}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Flow 'volume_create_manager' (f29a75fc-20b8-43a8-b3f2-1a5e18cb1010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97509050-e6bb-4dd7-8256-c6091d9c08a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97509050-e6bb-4dd7-8256-c6091d9c08a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1299499560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f163b094-9b4a-48d1-93dd-82016b64406c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e07a42db8245bab6ea15a24a0d3113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:49Z,use_quota=True,user_id='5e2f23f429e34829a4f5d6fe9aa45ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21302147-e5e4-4d79-9aea-f134c96c53ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21302147-e5e4-4d79-9aea-f134c96c53ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cc6f94-61e0-46cd-906f-9db7f5c47f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cc6f94-61e0-46cd-906f-9db7f5c47f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f163b094-9b4a-48d1-93dd-82016b64406c', 'volume_name': 'volume-f163b094-9b4a-48d1-93dd-82016b64406c', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e55ccb-2481-4c98-af3e-de4f4a1a348c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e55ccb-2481-4c98-af3e-de4f4a1a348c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1015e1a4-66f6-4d36-aadc-39fbecedd279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:48 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume f163b094-9b4a-48d1-93dd-82016b64406c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f163b094-9b4a-48d1-93dd-82016b64406c', 'volume_size': 1}
Jul 09 09:12:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:49 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04 1073741824" returned: 0 in 1.031s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:49 devstack sudo[99226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04
Jul 09 09:12:49 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Flow 'volume_create_manager' (67ad03f3-8555-41fd-854b-5334f7597474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff0dac0-b100-41ac-b14f-5730a3bd6870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff0dac0-b100-41ac-b14f-5730a3bd6870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400694969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1dbd47-76e3-41ba-b0e4-70bfd48764c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e07a42db8245bab6ea15a24a0d3113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:49Z,use_quota=True,user_id='5e2f23f429e34829a4f5d6fe9aa45ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b18d6f6-a96f-4753-b03c-e5affee1d63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b18d6f6-a96f-4753-b03c-e5affee1d63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96265cf4-dea7-4b12-af8b-ac06e423770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96265cf4-dea7-4b12-af8b-ac06e423770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b1dbd47-76e3-41ba-b0e4-70bfd48764c4', 'volume_name': 'volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43f0533-f14a-4c5c-91bf-5ee546a67ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43f0533-f14a-4c5c-91bf-5ee546a67ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8b840b-7b73-448c-956e-cb1cc7f1cf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:49 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume 0b1dbd47-76e3-41ba-b0e4-70bfd48764c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4', 'volume_size': 1}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Flow 'volume_create_manager' (60cdb68b-01ca-449c-adea-24f8e0914104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8068788-d812-4700-91de-e2a6e86817e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8068788-d812-4700-91de-e2a6e86817e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-433104218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d58009a-bc34-486e-b3df-5d6df7afeb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e07a42db8245bab6ea15a24a0d3113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:50Z,use_quota=True,user_id='5e2f23f429e34829a4f5d6fe9aa45ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5a8b5b-2aa5-4c85-8e13-01494802f78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5a8b5b-2aa5-4c85-8e13-01494802f78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b434bab-199e-4a5e-b55e-838fef2dfed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b434bab-199e-4a5e-b55e-838fef2dfed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d58009a-bc34-486e-b3df-5d6df7afeb9b', 'volume_name': 'volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b741e935-ba33-4450-8cb0-a80dbfab87f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b741e935-ba33-4450-8cb0-a80dbfab87f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923de5da-c25d-4678-8cd1-e0b485a4a562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:49 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume 4d58009a-bc34-486e-b3df-5d6df7afeb9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b', 'volume_size': 1}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:49 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04" returned: 0 in 0.792s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.354s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1492799027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433d4eac-5092-4cc7-949a-080763fef0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e07a42db8245bab6ea15a24a0d3113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:48Z,use_quota=True,user_id='5e2f23f429e34829a4f5d6fe9aa45ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Creating volume 433d4eac-5092-4cc7-949a-080763fef0aa {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:12:49 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-433d4eac-5092-4cc7-949a-080763fef0aa 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e546fd0-6251-432a-8319-f0acfd8f1226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:49 devstack sudo[99230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-433d4eac-5092-4cc7-949a-080763fef0aa 1073741824
Jul 09 09:12:49 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae89508c-5ec0-4ca8-b4e7-e68e6c7502a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:49 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04 (f4002e9d-3008-4def-bf81-1ec9cbd21d04): created successfully
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae89508c-5ec0-4ca8-b4e7-e68e6c7502a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Flow 'volume_create_manager' (3e43d2b9-337f-4709-91d7-ae355457966f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:49 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-16fda8a5-bff9-44ef-a1ab-db4a83c4d735 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Created volume successfully.
Jul 09 09:12:50 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-433d4eac-5092-4cc7-949a-080763fef0aa 1073741824" returned: 0 in 0.950s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:50 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=56,cinder:SELECT=50,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:12:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-433d4eac-5092-4cc7-949a-080763fef0aa {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:50 devstack sudo[99239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-433d4eac-5092-4cc7-949a-080763fef0aa
Jul 09 09:12:50 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:51 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-433d4eac-5092-4cc7-949a-080763fef0aa" returned: 0 in 0.731s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.647s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1299499560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f163b094-9b4a-48d1-93dd-82016b64406c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e07a42db8245bab6ea15a24a0d3113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:49Z,use_quota=True,user_id='5e2f23f429e34829a4f5d6fe9aa45ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Creating volume f163b094-9b4a-48d1-93dd-82016b64406c {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:12:51 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f163b094-9b4a-48d1-93dd-82016b64406c 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e0afb5-b3e0-4af9-9a3e-af9276e5ee20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433d4eac-5092-4cc7-949a-080763fef0aa', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:51 devstack sudo[99243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f163b094-9b4a-48d1-93dd-82016b64406c 1073741824
Jul 09 09:12:51 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1341cdac-12b7-44e1-bc90-b68023f69833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:51 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume volume-433d4eac-5092-4cc7-949a-080763fef0aa (433d4eac-5092-4cc7-949a-080763fef0aa): created successfully
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1341cdac-12b7-44e1-bc90-b68023f69833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Flow 'volume_create_manager' (68babffd-ab7f-42fa-ac5f-fe6c6fd39777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:51 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f293dcca-3bc9-4af4-bcdc-78bcba9c537d tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Created volume successfully.
Jul 09 09:12:52 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f163b094-9b4a-48d1-93dd-82016b64406c 1073741824" returned: 0 in 1.262s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f163b094-9b4a-48d1-93dd-82016b64406c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:52 devstack sudo[99249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f163b094-9b4a-48d1-93dd-82016b64406c
Jul 09 09:12:52 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:53 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f163b094-9b4a-48d1-93dd-82016b64406c" returned: 0 in 1.031s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] <== create_volume: return (2357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:12:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.362s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.646s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-400694969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1dbd47-76e3-41ba-b0e4-70bfd48764c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e07a42db8245bab6ea15a24a0d3113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:49Z,use_quota=True,user_id='5e2f23f429e34829a4f5d6fe9aa45ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Creating volume 0b1dbd47-76e3-41ba-b0e4-70bfd48764c4 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:12:54 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1015e1a4-66f6-4d36-aadc-39fbecedd279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f163b094-9b4a-48d1-93dd-82016b64406c', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00aea747-09fb-4e59-9e52-824b89355726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:54 devstack sudo[99253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4 1073741824
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:12:54 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:54 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume volume-f163b094-9b4a-48d1-93dd-82016b64406c (f163b094-9b4a-48d1-93dd-82016b64406c): created successfully
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00aea747-09fb-4e59-9e52-824b89355726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:54 devstack sudo[99255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:12:54 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Flow 'volume_create_manager' (f29a75fc-20b8-43a8-b3f2-1a5e18cb1010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:54 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b16d0e74-ebea-42c6-9098-8cf75bbcdeff tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Created volume successfully.
Jul 09 09:12:55 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.441s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:12:55 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:12:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:12:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:12:56 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4 1073741824" returned: 0 in 1.983s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:56 devstack sudo[99283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4
Jul 09 09:12:56 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:56 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4" returned: 0 in 0.714s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] <== create_volume: return (2750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.757s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.970s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-433104218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d58009a-bc34-486e-b3df-5d6df7afeb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e07a42db8245bab6ea15a24a0d3113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:12:50Z,use_quota=True,user_id='5e2f23f429e34829a4f5d6fe9aa45ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Creating volume 4d58009a-bc34-486e-b3df-5d6df7afeb9b {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:12:56 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8b840b-7b73-448c-956e-cb1cc7f1cf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:56 devstack sudo[99286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b 1073741824
Jul 09 09:12:56 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404e9a3c-025a-46d3-9b06-e8da97df3126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:56 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4 (0b1dbd47-76e3-41ba-b0e4-70bfd48764c4): created successfully
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404e9a3c-025a-46d3-9b06-e8da97df3126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Flow 'volume_create_manager' (67ad03f3-8555-41fd-854b-5334f7597474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:56 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-8829ca2f-31ec-44c9-be5f-abe3b94c4b61 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Created volume successfully.
Jul 09 09:12:57 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b 1073741824" returned: 0 in 0.912s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:57 devstack sudo[99291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b
Jul 09 09:12:57 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:12:58 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root
Jul 09 09:12:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b" returned: 0 in 0.708s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:12:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:12:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:12:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923de5da-c25d-4678-8cd1-e0b485a4a562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55f4189-4770-41a3-bbf7-e3b97636a1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:12:58 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Volume volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b (4d58009a-bc34-486e-b3df-5d6df7afeb9b): created successfully
Jul 09 09:12:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55f4189-4770-41a3-bbf7-e3b97636a1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:12:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Flow 'volume_create_manager' (60cdb68b-01ca-449c-adea-24f8e0914104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:12:58 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-8e4bd78b-7377-4505-ac8c-752414c03257 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Created volume successfully.
Jul 09 09:12:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "cinder-4d58009a-bc34-486e-b3df-5d6df7afeb9b-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:12:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-4d58009a-bc34-486e-b3df-5d6df7afeb9b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:12:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "cinder-quobyte-4d58009a-bc34-486e-b3df-5d6df7afeb9b" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:12:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-quobyte-4d58009a-bc34-486e-b3df-5d6df7afeb9b" acquired by "delete_volume" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:12:58 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bd8eb0-0213-4554-b1e3-49e666162960]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:12:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:12:58 devstack sudo[99295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b
Jul 09 09:12:58 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:00 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b" returned: 0 in 1.308s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:00 devstack sudo[99348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b
Jul 09 09:13:00 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:01 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d58009a-bc34-486e-b3df-5d6df7afeb9b" returned: 0 in 0.899s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-quobyte-4d58009a-bc34-486e-b3df-5d6df7afeb9b" released by "delete_volume" :: held 2.252s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:13:01 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Created reservations ['aa9d1d5d-f46a-4ca4-9b2e-96105a40b039', '021c6740-b209-4f52-b6a7-05dc2b17a5e4', '0cffd027-3a32-4516-8b97-8fc032eb82ba', 'c983a0ea-a6c6-4408-95ea-0de7423924cb'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:13:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:13:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:13:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:01 devstack sudo[99385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:13:01 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:02 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.817s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:02 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:13:02 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Deleted volume successfully.
Jul 09 09:13:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a4c458ce-5282-403b-9e57-fce821583f34 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-4d58009a-bc34-486e-b3df-5d6df7afeb9b-delete_volume" released by "delete_volume" :: held 3.388s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:13:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "cinder-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:13:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:13:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "cinder-quobyte-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:13:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-quobyte-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4" acquired by "delete_volume" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:13:02 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f17aa4-09d5-4eed-acf1-6463a4fea3af]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:13:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:02 devstack sudo[99390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4
Jul 09 09:13:02 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:03 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4" returned: 0 in 0.985s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:03 devstack sudo[99412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4
Jul 09 09:13:03 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:04 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4" returned: 0 in 0.770s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-quobyte-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4" released by "delete_volume" :: held 1.796s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Created reservations ['2905fd86-199d-4487-a37c-0ea574077fcd', '737655d1-7ca8-49e8-958b-d3ecc7b1677f', '8e6e7a87-3e49-496a-98c4-d0513ec0f887', 'aa86c4c8-491b-41d2-b47d-84875291e297'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:04 devstack sudo[99415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:13:04 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "cinder-f163b094-9b4a-48d1-93dd-82016b64406c-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-f163b094-9b4a-48d1-93dd-82016b64406c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "cinder-quobyte-f163b094-9b4a-48d1-93dd-82016b64406c" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-quobyte-f163b094-9b4a-48d1-93dd-82016b64406c" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a650d682-8cfd-4271-b86b-01f9a1a34e79]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:13:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f163b094-9b4a-48d1-93dd-82016b64406c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:04 devstack sudo[99417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f163b094-9b4a-48d1-93dd-82016b64406c
Jul 09 09:13:04 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:05 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.763s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:05 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:13:05 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Deleted volume successfully.
Jul 09 09:13:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ebd7b714-537e-44dd-98d1-055f0b1bac26 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-0b1dbd47-76e3-41ba-b0e4-70bfd48764c4-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:13:05 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f163b094-9b4a-48d1-93dd-82016b64406c" returned: 0 in 0.983s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f163b094-9b4a-48d1-93dd-82016b64406c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:05 devstack sudo[99425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f163b094-9b4a-48d1-93dd-82016b64406c
Jul 09 09:13:05 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:06 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f163b094-9b4a-48d1-93dd-82016b64406c" returned: 0 in 0.662s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-quobyte-f163b094-9b4a-48d1-93dd-82016b64406c" released by "delete_volume" :: held 1.716s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Created reservations ['97c1e688-d112-4512-bca3-2f2faa9dc713', '15d5f670-60b9-4e64-b3ca-e31b31a0d5c9', 'e1cd9a49-6e34-496e-8fa9-95561b906e6c', '62797b2f-d3a0-4183-b099-b48887d3aa4a'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:06 devstack sudo[99428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:13:06 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "cinder-433d4eac-5092-4cc7-949a-080763fef0aa-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-433d4eac-5092-4cc7-949a-080763fef0aa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "cinder-quobyte-433d4eac-5092-4cc7-949a-080763fef0aa" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-quobyte-433d4eac-5092-4cc7-949a-080763fef0aa" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a119f0-4f37-4876-bc4e-65844c09c71e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:13:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-433d4eac-5092-4cc7-949a-080763fef0aa {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:07 devstack sudo[99430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-433d4eac-5092-4cc7-949a-080763fef0aa
Jul 09 09:13:07 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:07 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.700s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:07 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:13:07 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Deleted volume successfully.
Jul 09 09:13:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3a89ec34-4f23-4da4-8206-f74ea934357a tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-f163b094-9b4a-48d1-93dd-82016b64406c-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:13:07 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-433d4eac-5092-4cc7-949a-080763fef0aa" returned: 0 in 0.784s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-433d4eac-5092-4cc7-949a-080763fef0aa {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:07 devstack sudo[99436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-433d4eac-5092-4cc7-949a-080763fef0aa
Jul 09 09:13:07 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:08 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-433d4eac-5092-4cc7-949a-080763fef0aa" returned: 0 in 0.652s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-quobyte-433d4eac-5092-4cc7-949a-080763fef0aa" released by "delete_volume" :: held 1.477s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:13:08 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Created reservations ['f5201961-2119-4ca1-8a12-d744e1015c20', 'efff52ae-93fc-4b76-9d25-684d232f3ea1', 'bb16cfa4-05b9-4b86-be28-43ba657eb7c0', '6eb460ca-c920-451d-a1fb-12ca5e6ab8d7'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:13:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:13:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:13:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:08 devstack sudo[99440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:13:08 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "cinder-f4002e9d-3008-4def-bf81-1ec9cbd21d04-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:13:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-f4002e9d-3008-4def-bf81-1ec9cbd21d04-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:13:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "cinder-quobyte-f4002e9d-3008-4def-bf81-1ec9cbd21d04" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:13:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-quobyte-f4002e9d-3008-4def-bf81-1ec9cbd21d04" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:13:09 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1469cac-b992-4a05-9b3f-d6348e138627]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:13:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:09 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.693s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:09 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:13:09 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Deleted volume successfully.
Jul 09 09:13:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-73f333d2-17bc-42d8-af48-7911e13bb333 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-433d4eac-5092-4cc7-949a-080763fef0aa-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:13:09 devstack sudo[99444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04
Jul 09 09:13:09 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:09 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04" returned: 0 in 0.798s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:10 devstack sudo[99449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04
Jul 09 09:13:10 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:10 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f4002e9d-3008-4def-bf81-1ec9cbd21d04" returned: 0 in 0.699s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-quobyte-f4002e9d-3008-4def-bf81-1ec9cbd21d04" released by "delete_volume" :: held 1.560s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:13:10 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Created reservations ['d9e29ae8-5918-451b-a2bc-8a1b8c146aa1', '0077a812-6982-4354-9dde-7331e86a176f', 'd790d700-9cea-4363-9719-85f17e4e3559', '149f5cdd-6466-4397-bfc2-0e4dd6c560d0'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:13:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:13:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:13:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:10 devstack sudo[99452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:13:10 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "cinder-a7579708-b349-4836-8e3d-7903640f298f-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:13:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-a7579708-b349-4836-8e3d-7903640f298f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:13:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "cinder-quobyte-a7579708-b349-4836-8e3d-7903640f298f" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:13:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-quobyte-a7579708-b349-4836-8e3d-7903640f298f" acquired by "delete_volume" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:13:11 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0978eb-1cf8-43d9-994f-500e8a443b63]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:13:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7579708-b349-4836-8e3d-7903640f298f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:11 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.751s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:11 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:13:11 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Deleted volume successfully.
Jul 09 09:13:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0c8a718b-f5e8-44f4-a256-096aa5062b44 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-f4002e9d-3008-4def-bf81-1ec9cbd21d04-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:13:11 devstack sudo[99455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7579708-b349-4836-8e3d-7903640f298f
Jul 09 09:13:11 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:12 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7579708-b349-4836-8e3d-7903640f298f" returned: 0 in 0.841s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7579708-b349-4836-8e3d-7903640f298f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:12 devstack sudo[99460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7579708-b349-4836-8e3d-7903640f298f
Jul 09 09:13:12 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:13 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7579708-b349-4836-8e3d-7903640f298f" returned: 0 in 0.632s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-quobyte-a7579708-b349-4836-8e3d-7903640f298f" released by "delete_volume" :: held 1.529s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:13:13 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Created reservations ['2e593952-a038-4266-b94d-6cb43e12025b', '274c65ea-3d7e-4b27-b963-b9c3c01844a3', 'b3e3ffc0-1463-43bd-bd8f-a04acb66881e', '072ca681-c9c6-4b00-82d3-3bb29862312a'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:13:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:13:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:13:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:13 devstack sudo[99463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:13:13 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:13 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.645s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:13 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:13:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Deleted volume successfully.
Jul 09 09:13:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b18bfda7-adc8-4585-9c97-19178b4a0990 tempest-CreateVolumesFromSourceVolumeTest-33586538 None] Lock "cinder-a7579708-b349-4836-8e3d-7903640f298f-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:13:23 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=57,cinder:SELECT=33,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:13:23 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=67,cinder:SELECT=41,cinder:DELETE=7,cinder:INSERT=17 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:13:23 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-f811e4d1-80d2-48a3-970e-da09907e6467 req-76f064e3-2d96-4797-a53a-52327bef8ca9 tempest-AttachVolumeNegativeTest-1492218879 None] Terminate volume connection completed successfully.
Jul 09 09:13:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-f811e4d1-80d2-48a3-970e-da09907e6467 req-76f064e3-2d96-4797-a53a-52327bef8ca9 tempest-AttachVolumeNegativeTest-1492218879 None] Deleting attachment 9930cf74-659a-4d72-b23a-eceed92ad349. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Flow 'volume_create_manager' (f357e5de-c891-49b5-af7d-9ae268ca955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a795e75c-ce15-41f8-93e3-4e33af57c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a795e75c-ce15-41f8-93e3-4e33af57c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1028674278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7da3fd2-51a5-41d9-95e4-57a872946ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b507275737549668735a0082a42b723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:13:26Z,use_quota=True,user_id='98a3057b4fb047cf97da5085cf8fbedf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b89080-b447-4db0-9317-59566114bb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b89080-b447-4db0-9317-59566114bb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e23d6b-92bb-4a98-8fab-bff24fe37308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e23d6b-92bb-4a98-8fab-bff24fe37308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7da3fd2-51a5-41d9-95e4-57a872946ec6', 'volume_name': 'volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f78685e-45b5-4a52-a53a-c4bc55908bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f78685e-45b5-4a52-a53a-c4bc55908bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e518fa27-11ab-4470-8055-8b5b9c11b5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:26 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Volume d7da3fd2-51a5-41d9-95e4-57a872946ec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6', 'volume_size': 1}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1028674278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7da3fd2-51a5-41d9-95e4-57a872946ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b507275737549668735a0082a42b723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:13:26Z,use_quota=True,user_id='98a3057b4fb047cf97da5085cf8fbedf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Creating volume d7da3fd2-51a5-41d9-95e4-57a872946ec6 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:13:26 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:13:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:26 devstack sudo[99570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6 1073741824
Jul 09 09:13:26 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:27 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6 1073741824" returned: 0 in 0.939s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:27 devstack sudo[99581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6
Jul 09 09:13:27 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:28 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6" returned: 0 in 0.834s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:13:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e518fa27-11ab-4470-8055-8b5b9c11b5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40524bc9-4a87-47cd-b0c5-6c5691d9c351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:28 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Volume volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6 (d7da3fd2-51a5-41d9-95e4-57a872946ec6): created successfully
Jul 09 09:13:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40524bc9-4a87-47cd-b0c5-6c5691d9c351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Flow 'volume_create_manager' (f357e5de-c891-49b5-af7d-9ae268ca955b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:13:28 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6d247510-8932-4aeb-9a8e-d567bfd1d5b1 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Created volume successfully.
Jul 09 09:13:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-c1ffc0c5-3ccf-4346-930d-707f6730aff2 req-5a906007-44db-46f9-9aa1-7076d277c95e tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-c1ffc0c5-3ccf-4346-930d-707f6730aff2 req-5a906007-44db-46f9-9aa1-7076d277c95e tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:33 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fa2c92-d37f-400e-8bb8-21ccbc882c5f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:13:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-c1ffc0c5-3ccf-4346-930d-707f6730aff2 req-5a906007-44db-46f9-9aa1-7076d277c95e tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:33 devstack sudo[99621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6
Jul 09 09:13:33 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:34 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-c1ffc0c5-3ccf-4346-930d-707f6730aff2 req-5a906007-44db-46f9-9aa1-7076d277c95e tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6" returned: 0 in 0.890s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-c1ffc0c5-3ccf-4346-930d-707f6730aff2 req-5a906007-44db-46f9-9aa1-7076d277c95e tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.918s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-c1ffc0c5-3ccf-4346-930d-707f6730aff2 req-5a906007-44db-46f9-9aa1-7076d277c95e tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be45cd1d-5555-4861-b8b6-8f1b2898c7c8', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:13:34 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-c1ffc0c5-3ccf-4346-930d-707f6730aff2 req-5a906007-44db-46f9-9aa1-7076d277c95e tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] attachment_update completed successfully.
Jul 09 09:13:39 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:13:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Flow 'volume_create_manager' (6e25bfaf-9d33-41df-8523-90fd95afb3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:13:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b89425-d032-414c-8916-ef94f9efe5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b89425-d032-414c-8916-ef94f9efe5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-931665614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a2f512-caa0-4ba8-9ffa-46692f040d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9979497bd41c4927b7db7c862a6ddbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:13:40Z,use_quota=True,user_id='6a58344ee97e4e1c877168f1edf7964a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2658a0ae-a378-4d3b-82b5-bc2eab690b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2658a0ae-a378-4d3b-82b5-bc2eab690b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da79ae6a-eadf-49c4-9784-5baa599d57c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da79ae6a-eadf-49c4-9784-5baa599d57c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a2f512-caa0-4ba8-9ffa-46692f040d5b', 'volume_name': 'volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5d261a-4649-417a-ae65-98aff6f09639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5d261a-4649-417a-ae65-98aff6f09639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dae2ede-62fa-4f93-944a-593057ad01b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:40 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Volume 78a2f512-caa0-4ba8-9ffa-46692f040d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b', 'volume_size': 1}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-931665614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a2f512-caa0-4ba8-9ffa-46692f040d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9979497bd41c4927b7db7c862a6ddbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:13:40Z,use_quota=True,user_id='6a58344ee97e4e1c877168f1edf7964a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Creating volume 78a2f512-caa0-4ba8-9ffa-46692f040d5b {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:13:40 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:40 devstack sudo[100014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b 1073741824
Jul 09 09:13:40 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:40 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b 1073741824" returned: 0 in 0.866s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:40 devstack sudo[100020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b
Jul 09 09:13:40 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:41 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b" returned: 0 in 0.657s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:13:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dae2ede-62fa-4f93-944a-593057ad01b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6837525-461c-4042-95aa-67148c9c3e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:41 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Volume volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b (78a2f512-caa0-4ba8-9ffa-46692f040d5b): created successfully
Jul 09 09:13:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6837525-461c-4042-95aa-67148c9c3e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Flow 'volume_create_manager' (6e25bfaf-9d33-41df-8523-90fd95afb3e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:13:41 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-caad91da-fdee-4783-9bf2-cd4ba464789e tempest-SnapshotDependencyTests-1162566639 None] Created volume successfully.
Jul 09 09:13:41 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-5438c076-8419-4930-b4c2-a82cbe40453c req-2ade30a2-eb1a-4476-8dae-aa26b5bb7d7f tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Terminate volume connection completed successfully.
Jul 09 09:13:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-5438c076-8419-4930-b4c2-a82cbe40453c req-2ade30a2-eb1a-4476-8dae-aa26b5bb7d7f tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Deleting attachment be45cd1d-5555-4861-b8b6-8f1b2898c7c8. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:13:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] Creating offline snapshot 5b0b26a4-1e8f-4975-8634-fff9aa87f2d5 of volume 78a2f512-caa0-4ba8-9ffa-46692f040d5b {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:13:42 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89ea286-9cb3-4f35-9908-610f9c839d38]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:13:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:42 devstack sudo[100051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b
Jul 09 09:13:42 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:43 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b" returned: 0 in 0.887s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:43 devstack sudo[100057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5 1G
Jul 09 09:13:43 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Acquiring lock "cinder-d7da3fd2-51a5-41d9-95e4-57a872946ec6-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:13:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Lock "cinder-d7da3fd2-51a5-41d9-95e4-57a872946ec6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:13:44 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5 1G" returned: 0 in 0.907s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Acquiring lock "cinder-quobyte-d7da3fd2-51a5-41d9-95e4-57a872946ec6" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:13:44 devstack sudo[100073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5
Jul 09 09:13:44 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Lock "cinder-quobyte-d7da3fd2-51a5-41d9-95e4-57a872946ec6" acquired by "delete_volume" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:13:44 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9173f0db-9f1e-4356-8b49-80765725ef5e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:13:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:44 devstack sudo[100078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6
Jul 09 09:13:44 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:44 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5" returned: 0 in 0.733s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:44 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5 is being set with open permissions: ugo+rw
Jul 09 09:13:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:44 devstack sudo[100088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5
Jul 09 09:13:44 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:45 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6" returned: 0 in 0.813s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:45 devstack sudo[100091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6
Jul 09 09:13:45 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:45 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5" returned: 0 in 0.685s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:45 devstack sudo[100095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.info
Jul 09 09:13:45 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:45 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d7da3fd2-51a5-41d9-95e4-57a872946ec6" returned: 0 in 0.705s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Lock "cinder-quobyte-d7da3fd2-51a5-41d9-95e4-57a872946ec6" released by "delete_volume" :: held 1.580s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:13:45 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Created reservations ['ccebb174-c5cd-49ee-8e75-ccbc63cd66bf', 'e046cafd-9dbd-456b-afc4-34a0a936762a', '87dc8f02-b315-47bd-afa3-95a08143aaab', '1f005998-ef00-4dab-9190-0ab4abd02226'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:13:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:13:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:13:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:45 devstack sudo[100098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:13:45 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:46 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.info" returned: 0 in 0.648s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:46 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.info is being set with open permissions: ugo+rw
Jul 09 09:13:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:46 devstack sudo[100101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.info
Jul 09 09:13:46 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:46 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.709s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:46 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:13:46 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Deleted volume successfully.
Jul 09 09:13:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c74119b9-75e6-4bb4-aa82-00c021649564 tempest-TestServerVolumeAttachScenarioOldVersion-489289565 None] Lock "cinder-d7da3fd2-51a5-41d9-95e4-57a872946ec6-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:13:47 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.info" returned: 0 in 0.844s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.839s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:47 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-cbe79f11-b470-4d4c-a09f-a64e3ab66a04 tempest-SnapshotDependencyTests-1162566639 None] Create snapshot completed successfully
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Flow 'volume_create_manager' (7bf53c8d-9b9e-4125-ad51-ef1b99a8885c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbdd60f-19b7-4c72-ab6b-60cadb2bfd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbdd60f-19b7-4c72-ab6b-60cadb2bfd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b035d17-2339-42e5-8172-a8a9a0afdf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9979497bd41c4927b7db7c862a6ddbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b0b26a4-1e8f-4975-8634-fff9aa87f2d5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:13:48Z,use_quota=True,user_id='6a58344ee97e4e1c877168f1edf7964a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d18a54b-1ad4-4298-82ab-a85ac74d1563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d18a54b-1ad4-4298-82ab-a85ac74d1563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33048cf3-f538-454e-8deb-8d2248dfb19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33048cf3-f538-454e-8deb-8d2248dfb19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b035d17-2339-42e5-8172-a8a9a0afdf76', 'volume_name': 'volume-6b035d17-2339-42e5-8172-a8a9a0afdf76', 'volume_size': 1, 'snapshot_id': '5b0b26a4-1e8f-4975-8634-fff9aa87f2d5'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6010bd-82be-4a3b-a5fb-da6b378d378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab6010bd-82be-4a3b-a5fb-da6b378d378f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a8bb4ff-d1f6-4ae8-b97e-fa40c30aea09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:13:48 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Volume 6b035d17-2339-42e5-8172-a8a9a0afdf76: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b035d17-2339-42e5-8172-a8a9a0afdf76', 'volume_size': 1, 'snapshot_id': '5b0b26a4-1e8f-4975-8634-fff9aa87f2d5'}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "cinder-quobyte-5b0b26a4-1e8f-4975-8634-fff9aa87f2d5-6b035d17-2339-42e5-8172-a8a9a0afdf76" by "_create_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-quobyte-5b0b26a4-1e8f-4975-8634-fff9aa87f2d5-6b035d17-2339-42e5-8172-a8a9a0afdf76" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Creating volume 6b035d17-2339-42e5-8172-a8a9a0afdf76 from snapshot 5b0b26a4-1e8f-4975-8634-fff9aa87f2d5 {{(pid=87009) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "cinder-quobyte-6b035d17-2339-42e5-8172-a8a9a0afdf76" by "_copy_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-quobyte-6b035d17-2339-42e5-8172-a8a9a0afdf76" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] snapshot: 5b0b26a4-1e8f-4975-8634-fff9aa87f2d5, volume: 6b035d17-2339-42e5-8172-a8a9a0afdf76,  {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[173bdc84-37d7-4a7d-b6c1-90064459d054]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:13:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:48 devstack sudo[100179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5
Jul 09 09:13:48 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:49 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5" returned: 0 in 0.957s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:13:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] will copy from snapshot at /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 09:13:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Creating direct copy from snapshot {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 09:13:49 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bca16b-acab-4962-a757-2ce12213d2c0]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:13:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:49 devstack sudo[100198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b
Jul 09 09:13:49 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:50 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b" returned: 0 in 0.912s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:50 devstack cinder-volume[87009]: DEBUG cinder.utils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Path /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76 not found in is_blk_device check {{(pid=87009) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 09:13:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:50 devstack sudo[100206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76
Jul 09 09:13:50 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:13:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:13:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:13:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:13:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:13:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:13:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:54 devstack sudo[100219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:13:54 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:56 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 2.674s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:56 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:13:56 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:13:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:13:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:13:58 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76" returned: 0 in 7.649s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:58 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95044f6-0320-4661-b3c9-16ae30a6dc1e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:13:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:58 devstack sudo[100225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b
Jul 09 09:13:58 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:13:59 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=26,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:13:59 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=19,cinder:UPDATE=25,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:13:59 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root
Jul 09 09:13:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b" returned: 0 in 1.241s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:13:59 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Image conversion details: src /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b, size 1024.00 MB, duration 7.65 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76 {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:13:59 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Converted 1024.00 MB image at 133.80 MB/s
Jul 09 09:13:59 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76 is being set with open permissions: ugo+rw
Jul 09 09:13:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:13:59 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76
Jul 09 09:13:59 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:00 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76" returned: 0 in 0.765s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-quobyte-6b035d17-2339-42e5-8172-a8a9a0afdf76" released by "_copy_volume_from_snapshot" :: held 11.682s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-quobyte-5b0b26a4-1e8f-4975-8634-fff9aa87f2d5-6b035d17-2339-42e5-8172-a8a9a0afdf76" released by "_create_volume_from_snapshot" :: held 11.716s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.737s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a8bb4ff-d1f6-4ae8-b97e-fa40c30aea09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b035d17-2339-42e5-8172-a8a9a0afdf76', 'volume_size': 1, 'snapshot_id': '5b0b26a4-1e8f-4975-8634-fff9aa87f2d5'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7967d0-eb3f-4a07-919c-1637355f04df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:14:00 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Volume volume-6b035d17-2339-42e5-8172-a8a9a0afdf76 (6b035d17-2339-42e5-8172-a8a9a0afdf76): created successfully
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7967d0-eb3f-4a07-919c-1637355f04df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Flow 'volume_create_manager' (7bf53c8d-9b9e-4125-ad51-ef1b99a8885c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:14:00 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-632f332d-9164-4c02-8ee2-725aa6be5cae tempest-SnapshotDependencyTests-1162566639 None] Created volume successfully.
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "cinder-5b0b26a4-1e8f-4975-8634-fff9aa87f2d5-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-5b0b26a4-1e8f-4975-8634-fff9aa87f2d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "cinder-quobyte-78a2f512-caa0-4ba8-9ffa-46692f040d5b" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-quobyte-78a2f512-caa0-4ba8-9ffa-46692f040d5b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "cinder-quobyte-5b0b26a4-1e8f-4975-8634-fff9aa87f2d5" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-quobyte-5b0b26a4-1e8f-4975-8634-fff9aa87f2d5" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Deleting offline snapshot 5b0b26a4-1e8f-4975-8634-fff9aa87f2d5 of volume 78a2f512-caa0-4ba8-9ffa-46692f040d5b {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] snapshot_file for this snap is: volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bbdcf7-13db-43ee-9271-72d4dd981697]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:14:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:01 devstack sudo[100242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5
Jul 09 09:14:01 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:01 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5" returned: 0 in 1.048s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:14:01 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9cc712-32b7-4d5e-9700-49bba993415f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:14:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:02 devstack sudo[100273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b
Jul 09 09:14:02 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:02 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b" returned: 0 in 0.831s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:02 devstack sudo[100280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5
Jul 09 09:14:02 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:03 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5" returned: 0 in 0.770s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:03 devstack sudo[100285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5
Jul 09 09:14:03 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:04 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b.5b0b26a4-1e8f-4975-8634-fff9aa87f2d5" returned: 0 in 0.647s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-quobyte-5b0b26a4-1e8f-4975-8634-fff9aa87f2d5" released by "_delete_snapshot" :: held 3.457s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:14:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-quobyte-78a2f512-caa0-4ba8-9ffa-46692f040d5b" released by "delete_snapshot" :: held 3.507s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:14:04 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Created reservations ['11d72328-00fb-4f96-a3e2-95cb256f946e', '94e87f83-8abb-4504-80f7-0f7a774f09ca', '85ef73de-cb9f-4aa8-ab9a-48a21cb028dd', 'b900069c-b6ba-4415-9b3e-9e5cf8667bce'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:14:04 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Delete snapshot completed successfully.
Jul 09 09:14:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-72987be9-2864-4132-8954-40b9c1188b1a tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-5b0b26a4-1e8f-4975-8634-fff9aa87f2d5-delete_snapshot" released by "delete_snapshot" :: held 3.655s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:14:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "cinder-78a2f512-caa0-4ba8-9ffa-46692f040d5b-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:14:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-78a2f512-caa0-4ba8-9ffa-46692f040d5b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:14:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "cinder-quobyte-78a2f512-caa0-4ba8-9ffa-46692f040d5b" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:14:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-quobyte-78a2f512-caa0-4ba8-9ffa-46692f040d5b" acquired by "delete_volume" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:14:05 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5375075b-894a-47fd-af39-ed6067440cf0]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:14:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:05 devstack sudo[100289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b
Jul 09 09:14:05 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:05 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b" returned: 0 in 0.816s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:06 devstack sudo[100295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b
Jul 09 09:14:06 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:06 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-78a2f512-caa0-4ba8-9ffa-46692f040d5b" returned: 0 in 0.690s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-quobyte-78a2f512-caa0-4ba8-9ffa-46692f040d5b" released by "delete_volume" :: held 1.580s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:14:06 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Created reservations ['8e13c75c-7df1-4950-846d-ee504e96fa21', '5a8c4f2d-c64a-4586-b938-b14f065b4485', '0fdd28ea-c55a-475b-b4cb-e09fe7a12f28', 'e30defd9-af54-4d0c-979e-f08adc4c4a8b'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:14:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:14:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:14:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:14:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:14:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:14:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:06 devstack sudo[100298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:14:06 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "cinder-6b035d17-2339-42e5-8172-a8a9a0afdf76-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:14:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-6b035d17-2339-42e5-8172-a8a9a0afdf76-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:14:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "cinder-quobyte-6b035d17-2339-42e5-8172-a8a9a0afdf76" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:14:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-quobyte-6b035d17-2339-42e5-8172-a8a9a0afdf76" acquired by "delete_volume" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:14:07 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9b6744-80d5-4af0-b708-c92f758c5ea9]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:14:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:07 devstack sudo[100301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76
Jul 09 09:14:07 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:07 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.733s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:07 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:14:07 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Deleted volume successfully.
Jul 09 09:14:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1a4970f6-d26b-4d1c-b9d7-86110869d3da tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-78a2f512-caa0-4ba8-9ffa-46692f040d5b-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:14:08 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76" returned: 0 in 0.844s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:08 devstack sudo[100307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76
Jul 09 09:14:08 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:09 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6b035d17-2339-42e5-8172-a8a9a0afdf76" returned: 0 in 0.744s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-quobyte-6b035d17-2339-42e5-8172-a8a9a0afdf76" released by "delete_volume" :: held 1.641s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:14:09 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Created reservations ['8cc4ea0d-f7ea-4984-9b53-d4f65386f24a', '0071d37a-e1e3-4385-a88a-d610c4218e4c', '2c1618e3-c464-4078-a1db-32465ebd7c51', 'e66e9d82-7d08-4391-b38a-004d5011aa52'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:14:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:14:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:14:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:14:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:14:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:14:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:09 devstack sudo[100311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:14:09 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:10 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.813s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:10 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:14:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Deleted volume successfully.
Jul 09 09:14:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c6d6610b-7066-413d-a0e3-11d450f0eabc tempest-SnapshotDependencyTests-1162566639 None] Lock "cinder-6b035d17-2339-42e5-8172-a8a9a0afdf76-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Flow 'volume_create_manager' (68900888-0cf3-43d1-96bb-a0ffec3303dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17461cd0-ef1d-4992-8e8e-b3f2770c0538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17461cd0-ef1d-4992-8e8e-b3f2770c0538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-110376737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9888d01-a215-400e-a25d-b5191dc842a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b64a5cbb4a4d56af35faa17ec46ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:14:12Z,use_quota=True,user_id='a95a30c3a47341a085f87b33c7ef514c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931e4a76-7ce5-4195-b3db-cecaa52bb984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931e4a76-7ce5-4195-b3db-cecaa52bb984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a318d253-d1ab-42e3-9a42-747e91bcfe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a318d253-d1ab-42e3-9a42-747e91bcfe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9888d01-a215-400e-a25d-b5191dc842a6', 'volume_name': 'volume-b9888d01-a215-400e-a25d-b5191dc842a6', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6db1f7-4c02-4700-9dc2-136a9e870139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6db1f7-4c02-4700-9dc2-136a9e870139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f402fc-613c-4fed-99d9-70af9a921683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:14:12 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Volume b9888d01-a215-400e-a25d-b5191dc842a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9888d01-a215-400e-a25d-b5191dc842a6', 'volume_size': 1}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-110376737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9888d01-a215-400e-a25d-b5191dc842a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b64a5cbb4a4d56af35faa17ec46ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:14:12Z,use_quota=True,user_id='a95a30c3a47341a085f87b33c7ef514c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Creating volume b9888d01-a215-400e-a25d-b5191dc842a6 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:14:12 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:14:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:12 devstack sudo[100317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6 1073741824
Jul 09 09:14:12 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:13 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6 1073741824" returned: 0 in 1.118s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:13 devstack sudo[100323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6
Jul 09 09:14:13 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:14 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6" returned: 0 in 0.787s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:14 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:14:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:14:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f402fc-613c-4fed-99d9-70af9a921683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9888d01-a215-400e-a25d-b5191dc842a6', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:14:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d8a6ac-fa6a-402b-8a45-880834c90f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:14:14 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Volume volume-b9888d01-a215-400e-a25d-b5191dc842a6 (b9888d01-a215-400e-a25d-b5191dc842a6): created successfully
Jul 09 09:14:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d8a6ac-fa6a-402b-8a45-880834c90f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:14:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Flow 'volume_create_manager' (68900888-0cf3-43d1-96bb-a0ffec3303dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:14:14 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b882e83b-bbf5-4a31-b745-715605f2a42c tempest-AttachVolumeNegativeTest-1492218879 None] Created volume successfully.
Jul 09 09:14:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-47f66c9b-7906-4405-a77b-f375eeaaa80f req-ac1dd73e-b8c3-4029-9368-69df3c41933c tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:14:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-47f66c9b-7906-4405-a77b-f375eeaaa80f req-ac1dd73e-b8c3-4029-9368-69df3c41933c tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:14:18 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c886ce3-4df6-472e-aa33-fa6205e72dbd]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:14:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-47f66c9b-7906-4405-a77b-f375eeaaa80f req-ac1dd73e-b8c3-4029-9368-69df3c41933c tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:19 devstack sudo[100339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6
Jul 09 09:14:19 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:19 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-47f66c9b-7906-4405-a77b-f375eeaaa80f req-ac1dd73e-b8c3-4029-9368-69df3c41933c tempest-AttachVolumeNegativeTest-1492218879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6" returned: 0 in 0.921s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-47f66c9b-7906-4405-a77b-f375eeaaa80f req-ac1dd73e-b8c3-4029-9368-69df3c41933c tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.948s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:14:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-47f66c9b-7906-4405-a77b-f375eeaaa80f req-ac1dd73e-b8c3-4029-9368-69df3c41933c tempest-AttachVolumeNegativeTest-1492218879 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-b9888d01-a215-400e-a25d-b5191dc842a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39fafd97-bbfb-4c63-a437-0ac86334654d', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:14:20 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-47f66c9b-7906-4405-a77b-f375eeaaa80f req-ac1dd73e-b8c3-4029-9368-69df3c41933c tempest-AttachVolumeNegativeTest-1492218879 None] attachment_update completed successfully.
Jul 09 09:14:26 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-fa0fcda9-03cc-47b8-aee1-ac3f3792094a req-3625d67b-8f54-4e84-8718-806acce77696 tempest-AttachVolumeNegativeTest-1492218879 None] Terminate volume connection completed successfully.
Jul 09 09:14:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-fa0fcda9-03cc-47b8-aee1-ac3f3792094a req-3625d67b-8f54-4e84-8718-806acce77696 tempest-AttachVolumeNegativeTest-1492218879 None] Deleting attachment 39fafd97-bbfb-4c63-a437-0ac86334654d. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Flow 'volume_create_manager' (c59a0351-5c6c-475e-a922-0dd9e7917be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203d6bf3-b813-4b09-a4d4-d6611f69a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203d6bf3-b813-4b09-a4d4-d6611f69a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-767423297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5739ba-e703-4ffb-be54-0e69a62a9c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7c0d4b59af5470cbcd7297acd2f8825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:14:31Z,use_quota=True,user_id='e21ba68150674e6da4e45e0d5ffd38ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c939b7-98ac-4f5a-84eb-7f1631ff6e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c939b7-98ac-4f5a-84eb-7f1631ff6e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7e2c0e-2111-4855-ab53-3a85d0fd7cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7e2c0e-2111-4855-ab53-3a85d0fd7cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf5739ba-e703-4ffb-be54-0e69a62a9c10', 'volume_name': 'volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3736167e-5dd9-4947-8c1e-364ae1bd835f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3736167e-5dd9-4947-8c1e-364ae1bd835f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f03cdf6-eae7-4a5a-9abe-12295d3073ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:14:30 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Volume bf5739ba-e703-4ffb-be54-0e69a62a9c10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10', 'volume_size': 1}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-767423297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5739ba-e703-4ffb-be54-0e69a62a9c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7c0d4b59af5470cbcd7297acd2f8825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:14:31Z,use_quota=True,user_id='e21ba68150674e6da4e45e0d5ffd38ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Creating volume bf5739ba-e703-4ffb-be54-0e69a62a9c10 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:14:30 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:14:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:30 devstack sudo[100817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 1073741824
Jul 09 09:14:30 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:31 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 1073741824" returned: 0 in 1.044s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:32 devstack sudo[100827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10
Jul 09 09:14:32 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:32 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10" returned: 0 in 0.692s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:14:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:14:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f03cdf6-eae7-4a5a-9abe-12295d3073ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:14:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c677bff-9a48-4349-9514-682a8225d4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:14:32 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Volume volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 (bf5739ba-e703-4ffb-be54-0e69a62a9c10): created successfully
Jul 09 09:14:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c677bff-9a48-4349-9514-682a8225d4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:14:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Flow 'volume_create_manager' (c59a0351-5c6c-475e-a922-0dd9e7917be3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:14:32 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6f9a5494-2d8b-45e8-9722-436d58fecad1 tempest-TestStampPattern-81593443 None] Created volume successfully.
Jul 09 09:14:42 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=40,cinder:DELETE=2,cinder:SELECT=24,cinder:INSERT=9 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:14:42 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=29,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:14:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:14:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:14:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:14:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:14:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:14:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:14:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:14:54 devstack sudo[101018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:14:54 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:14:54 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root
Jul 09 09:14:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.730s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:14:54 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:14:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:14:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:14:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:15:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-cc8b7c16-5d17-4b0b-8d59-04507e77084c req-1d7640ee-1f66-4fea-af2e-838dbd794a6a tempest-TestStampPattern-81593443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:15:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-cc8b7c16-5d17-4b0b-8d59-04507e77084c req-1d7640ee-1f66-4fea-af2e-838dbd794a6a tempest-TestStampPattern-81593443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:15:12 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[180047ea-1c77-43f8-a2f3-1630855d79d1]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:15:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-cc8b7c16-5d17-4b0b-8d59-04507e77084c req-1d7640ee-1f66-4fea-af2e-838dbd794a6a tempest-TestStampPattern-81593443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:12 devstack sudo[101090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10
Jul 09 09:15:12 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:13 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-cc8b7c16-5d17-4b0b-8d59-04507e77084c req-1d7640ee-1f66-4fea-af2e-838dbd794a6a tempest-TestStampPattern-81593443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10" returned: 0 in 0.762s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-cc8b7c16-5d17-4b0b-8d59-04507e77084c req-1d7640ee-1f66-4fea-af2e-838dbd794a6a tempest-TestStampPattern-81593443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.779s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:15:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-cc8b7c16-5d17-4b0b-8d59-04507e77084c req-1d7640ee-1f66-4fea-af2e-838dbd794a6a tempest-TestStampPattern-81593443 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5394dc1f-7557-404b-8b59-5bf5c0aedc26', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:15:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-cc8b7c16-5d17-4b0b-8d59-04507e77084c req-1d7640ee-1f66-4fea-af2e-838dbd794a6a tempest-TestStampPattern-81593443 None] attachment_update completed successfully.
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Flow 'volume_create_manager' (51ae1eaf-2be4-4514-b02f-3e20e14e4923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2d1ef8-220f-4340-a56b-1f3e17b6f06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2d1ef8-220f-4340-a56b-1f3e17b6f06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-896167444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0ef8af-8718-4e6b-acbd-e13a99a5e10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b64a5cbb4a4d56af35faa17ec46ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:15:16Z,use_quota=True,user_id='a95a30c3a47341a085f87b33c7ef514c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179c1775-3f08-49f1-b4e0-3957defc56da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179c1775-3f08-49f1-b4e0-3957defc56da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0cac92-8aa1-4bad-9edf-e20dedeea379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0cac92-8aa1-4bad-9edf-e20dedeea379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab0ef8af-8718-4e6b-acbd-e13a99a5e10e', 'volume_name': 'volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f7d171-89bb-4dce-ac30-96295c84ce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f7d171-89bb-4dce-ac30-96295c84ce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cffb393-93f5-4747-b22b-08018c34bd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:15:16 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Volume ab0ef8af-8718-4e6b-acbd-e13a99a5e10e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e', 'volume_size': 1}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-896167444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0ef8af-8718-4e6b-acbd-e13a99a5e10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b64a5cbb4a4d56af35faa17ec46ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:15:16Z,use_quota=True,user_id='a95a30c3a47341a085f87b33c7ef514c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Creating volume ab0ef8af-8718-4e6b-acbd-e13a99a5e10e {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:15:16 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:15:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:16 devstack sudo[101480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e 1073741824
Jul 09 09:15:16 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:17 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e 1073741824" returned: 0 in 0.844s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:17 devstack sudo[101485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e
Jul 09 09:15:17 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:18 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e" returned: 0 in 0.664s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:15:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:15:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cffb393-93f5-4747-b22b-08018c34bd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:15:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8cf698-b464-4793-ad47-271fd675dc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:15:18 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Volume volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e (ab0ef8af-8718-4e6b-acbd-e13a99a5e10e): created successfully
Jul 09 09:15:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8cf698-b464-4793-ad47-271fd675dc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:15:18 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Flow 'volume_create_manager' (51ae1eaf-2be4-4514-b02f-3e20e14e4923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:15:18 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-81d47860-11c7-496d-ab79-bb44bf84e973 tempest-AttachVolumeNegativeTest-1492218879 None] Created volume successfully.
Jul 09 09:15:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-8abe6f3b-ca88-4632-b1d1-3da1490a783e req-46eaa321-c9fc-4510-b573-ff53e9f4ecb6 tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:15:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-8abe6f3b-ca88-4632-b1d1-3da1490a783e req-46eaa321-c9fc-4510-b573-ff53e9f4ecb6 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:15:21 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2595ee9-d344-4f4b-8fd7-e8c304f3db5a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:15:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-8abe6f3b-ca88-4632-b1d1-3da1490a783e req-46eaa321-c9fc-4510-b573-ff53e9f4ecb6 tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:21 devstack sudo[101523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e
Jul 09 09:15:21 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:21 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-39c4d282-613f-4a6a-8f52-f39e77cc6583 req-f0adaeab-7e5b-4739-9321-737492efcefe tempest-TestStampPattern-81593443 None] Terminate volume connection completed successfully.
Jul 09 09:15:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-39c4d282-613f-4a6a-8f52-f39e77cc6583 req-f0adaeab-7e5b-4739-9321-737492efcefe tempest-TestStampPattern-81593443 None] Deleting attachment 5394dc1f-7557-404b-8b59-5bf5c0aedc26. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:15:22 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-8abe6f3b-ca88-4632-b1d1-3da1490a783e req-46eaa321-c9fc-4510-b573-ff53e9f4ecb6 tempest-AttachVolumeNegativeTest-1492218879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e" returned: 0 in 0.794s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-8abe6f3b-ca88-4632-b1d1-3da1490a783e req-46eaa321-c9fc-4510-b573-ff53e9f4ecb6 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.810s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:15:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-8abe6f3b-ca88-4632-b1d1-3da1490a783e req-46eaa321-c9fc-4510-b573-ff53e9f4ecb6 tempest-AttachVolumeNegativeTest-1492218879 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c58bc28f-b6fb-4b53-96c5-4b46c5e536bc', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:15:22 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-8abe6f3b-ca88-4632-b1d1-3da1490a783e req-46eaa321-c9fc-4510-b573-ff53e9f4ecb6 tempest-AttachVolumeNegativeTest-1492218879 None] attachment_update completed successfully.
Jul 09 09:15:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:15:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:15:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] Creating offline snapshot 1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc of volume bf5739ba-e703-4ffb-be54-0e69a62a9c10 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:15:23 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6ab863-ea5f-4d4f-8d90-55c35407ada2]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:15:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:23 devstack sudo[101949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10
Jul 09 09:15:23 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:24 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10" returned: 0 in 0.772s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:24 devstack sudo[101980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc 1G
Jul 09 09:15:24 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:25 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc 1G" returned: 0 in 0.826s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:25 devstack sudo[101985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc
Jul 09 09:15:25 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:26 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc" returned: 0 in 0.721s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:26 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc is being set with open permissions: ugo+rw
Jul 09 09:15:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:26 devstack sudo[101991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc
Jul 09 09:15:26 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:26 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc" returned: 0 in 0.680s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:26 devstack sudo[101994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.info
Jul 09 09:15:26 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:27 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.info" returned: 0 in 0.672s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:27 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.info is being set with open permissions: ugo+rw
Jul 09 09:15:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:27 devstack sudo[101997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.info
Jul 09 09:15:27 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:28 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.info" returned: 0 in 0.643s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.405s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:15:28 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-eef82d7b-4b0b-41d1-90fc-769eb9eb2c76 tempest-TestStampPattern-81593443 None] Create snapshot completed successfully
Jul 09 09:15:28 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-e3f278e5-45e5-4bb6-8c13-90ac60f0b35d req-3e236e4d-8b2e-4419-8416-1342e12a366e tempest-AttachVolumeNegativeTest-1492218879 None] Terminate volume connection completed successfully.
Jul 09 09:15:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-e3f278e5-45e5-4bb6-8c13-90ac60f0b35d req-3e236e4d-8b2e-4419-8416-1342e12a366e tempest-AttachVolumeNegativeTest-1492218879 None] Deleting attachment c58bc28f-b6fb-4b53-96c5-4b46c5e536bc. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=21,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=16,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "cinder-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "cinder-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "cinder-quobyte-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "cinder-quobyte-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e" acquired by "delete_volume" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[94020ca4-b632-4421-b4aa-b623f3f6af3c]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:15:38 devstack sudo[102091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e
Jul 09 09:15:38 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Flow 'volume_create_manager' (880ca95d-b86a-475e-8355-fddf645b5472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326a0dd0-87e6-4a57-a479-656c0580b986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326a0dd0-87e6-4a57-a479-656c0580b986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2074390849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7c0d4b59af5470cbcd7297acd2f8825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:15:39Z,use_quota=True,user_id='e21ba68150674e6da4e45e0d5ffd38ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80e32b6-81d9-4e29-ac73-3ba29f0abb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80e32b6-81d9-4e29-ac73-3ba29f0abb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409b3899-b2e1-4744-9472-60531c8065ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409b3899-b2e1-4744-9472-60531c8065ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd', 'volume_name': 'volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd', 'volume_size': 1, 'snapshot_id': '1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72b80c6-e5b2-4295-86aa-33515646a775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72b80c6-e5b2-4295-86aa-33515646a775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87f49da-a3b8-478b-b0ee-42825e10bd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:15:38 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Volume 1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd', 'volume_size': 1, 'snapshot_id': '1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc'}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Acquiring lock "cinder-quobyte-1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd" by "_create_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Lock "cinder-quobyte-1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Creating volume 1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd from snapshot 1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc {{(pid=87009) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Acquiring lock "cinder-quobyte-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd" by "_copy_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Lock "cinder-quobyte-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] snapshot: 1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc, volume: 1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd,  {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1e23a4-ab20-4b1f-813c-cbcda2da2b40]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:15:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:39 devstack sudo[102093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc
Jul 09 09:15:39 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:39 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e" returned: 0 in 0.843s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:39 devstack sudo[102102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e
Jul 09 09:15:39 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:39 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc" returned: 0 in 0.858s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:15:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] will copy from snapshot at /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 09:15:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Creating direct copy from snapshot {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 09:15:39 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eacac62-a9d5-4d0f-b07f-beea21eaddfc]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:15:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:39 devstack sudo[102108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10
Jul 09 09:15:39 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:40 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e" returned: 0 in 0.700s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "cinder-quobyte-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e" released by "delete_volume" :: held 1.601s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Created reservations ['23ae0410-76d7-4470-88be-e2067f729be9', 'f4ab776b-0b2b-4165-817a-e976b1b8f521', '116f74d6-c39c-4899-8cfb-e9330a59bcc7', 'ab4daaeb-a879-4814-9c96-8a14d2ff3cac'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:40 devstack sudo[102111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:15:40 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:40 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10" returned: 0 in 0.794s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG cinder.utils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Path /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd not found in is_blk_device check {{(pid=87009) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:40 devstack sudo[102116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd
Jul 09 09:15:40 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "cinder-b9888d01-a215-400e-a25d-b5191dc842a6-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Lock "cinder-b9888d01-a215-400e-a25d-b5191dc842a6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "cinder-quobyte-b9888d01-a215-400e-a25d-b5191dc842a6" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Lock "cinder-quobyte-b9888d01-a215-400e-a25d-b5191dc842a6" acquired by "delete_volume" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ef7c8b-08b5-42da-8f83-3199fe48db26]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:15:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:41 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.726s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:41 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:15:41 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Deleted volume successfully.
Jul 09 09:15:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb4284ea-38f3-4337-a920-7e62d6094ac4 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "cinder-ab0ef8af-8718-4e6b-acbd-e13a99a5e10e-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:15:41 devstack sudo[102119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6
Jul 09 09:15:41 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:42 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6" returned: 0 in 1.243s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:42 devstack sudo[102134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6
Jul 09 09:15:42 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:43 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b9888d01-a215-400e-a25d-b5191dc842a6" returned: 0 in 1.600s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Lock "cinder-quobyte-b9888d01-a215-400e-a25d-b5191dc842a6" released by "delete_volume" :: held 2.919s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:15:43 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Created reservations ['227d4e5d-7a20-4ede-a882-fbda5be6ad8c', 'ec873a7d-1cc8-4513-8d29-565211ee1480', 'f8a5a36f-1f31-44a1-aa59-16e98d4c6858', '60f5e23d-bfb0-43e8-9f14-47a52d57989d'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:15:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:15:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:15:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:15:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:15:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:15:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:44 devstack sudo[102137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:15:44 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "cinder-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:15:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "cinder-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:15:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "cinder-quobyte-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:15:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "cinder-quobyte-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa" acquired by "delete_volume" :: waited 0.050s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:15:45 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadc5e86-3202-4970-bc70-f0c9e286b0cc]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:15:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:45 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.723s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:45 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:15:45 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Deleted volume successfully.
Jul 09 09:15:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3284f29d-8436-4744-97f2-4c86ff6e0cec tempest-AttachVolumeNegativeTest-1492218879 None] Lock "cinder-b9888d01-a215-400e-a25d-b5191dc842a6-delete_volume" released by "delete_volume" :: held 5.039s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:15:46 devstack sudo[102140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa
Jul 09 09:15:46 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:46 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd" returned: 0 in 5.796s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:46 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e17b196-ca45-4636-bac5-2ee117ee584a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:15:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:46 devstack sudo[102142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10
Jul 09 09:15:46 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:46 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa" returned: 0 in 1.371s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:47 devstack sudo[102147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa
Jul 09 09:15:47 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:47 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa" returned: 0 in 0.932s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:47 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "cinder-quobyte-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa" released by "delete_volume" :: held 2.410s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:15:48 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Created reservations ['94a7a390-974b-486c-96ba-94822dc2c7da', '793d5132-70e9-4d5a-b8fc-a99f5bacdb8b', '327164ce-947e-4d8b-a2de-d556b9326f9a', 'dac3af12-63fd-49e3-a52b-5eb5f8100b44'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10" returned: 0 in 1.569s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Image conversion details: src /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:15:48 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Converted 1024.00 MB image at 176.65 MB/s
Jul 09 09:15:48 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd is being set with open permissions: ugo+rw
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:48 devstack sudo[102153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd
Jul 09 09:15:48 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:48 devstack sudo[102156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:15:48 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:48 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd" returned: 0 in 0.769s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Lock "cinder-quobyte-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd" released by "_copy_volume_from_snapshot" :: held 9.901s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Lock "cinder-quobyte-1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd" released by "_create_volume_from_snapshot" :: held 9.947s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.966s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b87f49da-a3b8-478b-b0ee-42825e10bd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd', 'volume_size': 1, 'snapshot_id': '1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722c6a48-38c6-4975-89d6-d6d462834425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:15:48 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Volume volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd (1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd): created successfully
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722c6a48-38c6-4975-89d6-d6d462834425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Flow 'volume_create_manager' (880ca95d-b86a-475e-8355-fddf645b5472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:15:48 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-15e27694-8130-4406-8e91-bcd2fcc94062 tempest-TestStampPattern-81593443 None] Created volume successfully.
Jul 09 09:15:48 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.796s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:48 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:15:48 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Deleted volume successfully.
Jul 09 09:15:49 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-98343cbb-4079-424e-9859-602637b324a6 tempest-AttachVolumeNegativeTest-1492218879 None] Lock "cinder-c7b77ec4-d64c-46b4-b05d-fdec8159a7aa-delete_volume" released by "delete_volume" :: held 3.702s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:15:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:15:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:15:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:15:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:15:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:15:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:15:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:15:54 devstack sudo[102228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:15:54 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:15:55 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root
Jul 09 09:15:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.894s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:15:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:15:55 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:15:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:15:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:15:59 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=18,cinder:UPDATE=28,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:15:59 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=18,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:16:07 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2d5a7fa1-aaa7-4fca-99aa-5086199d1d49 tempest-GroupsV320Test-1750519414 None] Group tempest-GroupsV320Test-Group-103720745: creating
Jul 09 09:16:07 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2d5a7fa1-aaa7-4fca-99aa-5086199d1d49 tempest-GroupsV320Test-1750519414 None] Group tempest-GroupsV320Test-Group-103720745: created successfully
Jul 09 09:16:07 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2d5a7fa1-aaa7-4fca-99aa-5086199d1d49 tempest-GroupsV320Test-1750519414 None] Create group completed successfully.
Jul 09 09:16:08 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-68880070-5f34-4f81-af51-f7e1254a4ef3 tempest-GroupsV320Test-1750519414 None] Created reservations ['e4611931-0ecb-47a9-8a74-4d88d1086296'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:16:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-68880070-5f34-4f81-af51-f7e1254a4ef3 tempest-GroupsV320Test-1750519414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-68880070-5f34-4f81-af51-f7e1254a4ef3 tempest-GroupsV320Test-1750519414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-68880070-5f34-4f81-af51-f7e1254a4ef3 tempest-GroupsV320Test-1750519414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-68880070-5f34-4f81-af51-f7e1254a4ef3 tempest-GroupsV320Test-1750519414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-68880070-5f34-4f81-af51-f7e1254a4ef3 tempest-GroupsV320Test-1750519414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-68880070-5f34-4f81-af51-f7e1254a4ef3 tempest-GroupsV320Test-1750519414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:08 devstack sudo[102266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:16:08 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:09 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-68880070-5f34-4f81-af51-f7e1254a4ef3 tempest-GroupsV320Test-1750519414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.638s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:09 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-68880070-5f34-4f81-af51-f7e1254a4ef3 tempest-GroupsV320Test-1750519414 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:16:09 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-68880070-5f34-4f81-af51-f7e1254a4ef3 tempest-GroupsV320Test-1750519414 None] Delete group completed successfully.
Jul 09 09:16:18 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:16:18 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=4,cinder:SELECT=6 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:16:23 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Flow 'volume_create_manager' (4876ce2b-61a9-44ec-978b-38d289c4c1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3ad781-c548-4f67-be0f-b6ff0d539878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd3ad781-c548-4f67-be0f-b6ff0d539878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-486585519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e0bb973-351d-411b-8793-a820b153e8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cc87caa3994562a4e59a41df045d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:24Z,use_quota=True,user_id='bfcdebd38aad4c59b4cc72fb369106bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c4152d-2667-4a65-9f35-64b6f1df1b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c4152d-2667-4a65-9f35-64b6f1df1b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80b4285-4cde-400b-9b2e-e23cd3aa0a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80b4285-4cde-400b-9b2e-e23cd3aa0a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e0bb973-351d-411b-8793-a820b153e8f3', 'volume_name': 'volume-4e0bb973-351d-411b-8793-a820b153e8f3', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572006d9-ffd9-453f-9550-cf4fa80cf740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572006d9-ffd9-453f-9550-cf4fa80cf740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0234bf5-a7fb-4b0b-bfdc-7ac6ca21923b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:24 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Volume 4e0bb973-351d-411b-8793-a820b153e8f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e0bb973-351d-411b-8793-a820b153e8f3', 'volume_size': 1}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-486585519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e0bb973-351d-411b-8793-a820b153e8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cc87caa3994562a4e59a41df045d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:24Z,use_quota=True,user_id='bfcdebd38aad4c59b4cc72fb369106bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Creating volume 4e0bb973-351d-411b-8793-a820b153e8f3 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:16:24 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4e0bb973-351d-411b-8793-a820b153e8f3 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:24 devstack sudo[102281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4e0bb973-351d-411b-8793-a820b153e8f3 1073741824
Jul 09 09:16:24 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-34255d0a-df33-4be0-aab4-198f2e1bfa5f req-e6a57eae-3e39-47c6-941f-8a8f62935a3c tempest-TestStampPattern-81593443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:24 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4e0bb973-351d-411b-8793-a820b153e8f3 1073741824" returned: 0 in 0.861s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4e0bb973-351d-411b-8793-a820b153e8f3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:24 devstack sudo[102330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4e0bb973-351d-411b-8793-a820b153e8f3
Jul 09 09:16:24 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:25 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4e0bb973-351d-411b-8793-a820b153e8f3" returned: 0 in 0.662s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:16:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-34255d0a-df33-4be0-aab4-198f2e1bfa5f req-e6a57eae-3e39-47c6-941f-8a8f62935a3c tempest-TestStampPattern-81593443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.956s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0234bf5-a7fb-4b0b-bfdc-7ac6ca21923b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e0bb973-351d-411b-8793-a820b153e8f3', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1f3d0e-e556-4724-a178-adfcc08c72ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:25 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f12a4c-3196-4fdc-9c87-5a16dca9e35d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:16:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-34255d0a-df33-4be0-aab4-198f2e1bfa5f req-e6a57eae-3e39-47c6-941f-8a8f62935a3c tempest-TestStampPattern-81593443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:25 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Volume volume-4e0bb973-351d-411b-8793-a820b153e8f3 (4e0bb973-351d-411b-8793-a820b153e8f3): created successfully
Jul 09 09:16:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1f3d0e-e556-4724-a178-adfcc08c72ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Flow 'volume_create_manager' (4876ce2b-61a9-44ec-978b-38d289c4c1c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:16:25 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d572baf4-ec4a-4b41-8995-5cc2aabe27ff tempest-VolumesListAdminTestJSON-280598216 None] Created volume successfully.
Jul 09 09:16:25 devstack sudo[102333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd
Jul 09 09:16:25 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:26 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-34255d0a-df33-4be0-aab4-198f2e1bfa5f req-e6a57eae-3e39-47c6-941f-8a8f62935a3c tempest-TestStampPattern-81593443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd" returned: 0 in 0.807s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-34255d0a-df33-4be0-aab4-198f2e1bfa5f req-e6a57eae-3e39-47c6-941f-8a8f62935a3c tempest-TestStampPattern-81593443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.836s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-34255d0a-df33-4be0-aab4-198f2e1bfa5f req-e6a57eae-3e39-47c6-941f-8a8f62935a3c tempest-TestStampPattern-81593443 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aaf9af4e-4138-40a3-a628-339c7f5b1092', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:16:26 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-34255d0a-df33-4be0-aab4-198f2e1bfa5f req-e6a57eae-3e39-47c6-941f-8a8f62935a3c tempest-TestStampPattern-81593443 None] attachment_update completed successfully.
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Flow 'volume_create_manager' (a6ceecfe-8af3-49e7-8e41-b543b89bbc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf668def-4396-4879-84f8-3605973035b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf668def-4396-4879-84f8-3605973035b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-972682451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b713a2-ebb7-4c53-882c-4a2b08a5d25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cc87caa3994562a4e59a41df045d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:27Z,use_quota=True,user_id='bfcdebd38aad4c59b4cc72fb369106bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56771deb-ede5-43f9-a1eb-4c490bd7c5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56771deb-ede5-43f9-a1eb-4c490bd7c5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a40c6f-1bb2-4c4b-94eb-f31eb4bd7992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a40c6f-1bb2-4c4b-94eb-f31eb4bd7992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b713a2-ebb7-4c53-882c-4a2b08a5d25e', 'volume_name': 'volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae3402d-e199-4c9e-bb70-36c7d78c8c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae3402d-e199-4c9e-bb70-36c7d78c8c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa007baf-0e71-4c92-989c-d090c7aebaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:26 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Volume b2b713a2-ebb7-4c53-882c-4a2b08a5d25e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e', 'volume_size': 1}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-972682451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b713a2-ebb7-4c53-882c-4a2b08a5d25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cc87caa3994562a4e59a41df045d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:27Z,use_quota=True,user_id='bfcdebd38aad4c59b4cc72fb369106bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Creating volume b2b713a2-ebb7-4c53-882c-4a2b08a5d25e {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:16:26 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:16:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:26 devstack sudo[102339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e 1073741824
Jul 09 09:16:26 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:27 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e 1073741824" returned: 0 in 0.837s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:27 devstack sudo[102726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e
Jul 09 09:16:27 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:28 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e" returned: 0 in 0.620s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:16:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa007baf-0e71-4c92-989c-d090c7aebaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53585d1a-9967-4fee-880d-31ca44f69f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:28 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Volume volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e (b2b713a2-ebb7-4c53-882c-4a2b08a5d25e): created successfully
Jul 09 09:16:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53585d1a-9967-4fee-880d-31ca44f69f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Flow 'volume_create_manager' (a6ceecfe-8af3-49e7-8e41-b543b89bbc4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:16:28 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3695f869-2d47-47dc-990c-142e2621a477 tempest-VolumesListAdminTestJSON-280598216 None] Created volume successfully.
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Flow 'volume_create_manager' (b5e73e59-c858-4877-9136-f1b8648c7d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef0561b-2371-4358-a364-3a9c4d6a5653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef0561b-2371-4358-a364-3a9c4d6a5653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1727482150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df779da-3f7e-471f-b9b3-3b0d2451f4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cc87caa3994562a4e59a41df045d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:29Z,use_quota=True,user_id='bfcdebd38aad4c59b4cc72fb369106bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274477be-879a-4322-a73b-c0ae0129b9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274477be-879a-4322-a73b-c0ae0129b9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293e9e5e-1015-4977-ae64-fe885f8fdb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293e9e5e-1015-4977-ae64-fe885f8fdb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df779da-3f7e-471f-b9b3-3b0d2451f4fd', 'volume_name': 'volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84014c8d-8682-4e3c-ab4b-c72a1351f0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84014c8d-8682-4e3c-ab4b-c72a1351f0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d567f2-6384-49b8-9029-9dc62224f2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:29 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Volume 8df779da-3f7e-471f-b9b3-3b0d2451f4fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd', 'volume_size': 1}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1727482150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df779da-3f7e-471f-b9b3-3b0d2451f4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5cc87caa3994562a4e59a41df045d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:29Z,use_quota=True,user_id='bfcdebd38aad4c59b4cc72fb369106bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Creating volume 8df779da-3f7e-471f-b9b3-3b0d2451f4fd {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:16:29 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:16:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:29 devstack sudo[102730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd 1073741824
Jul 09 09:16:29 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:30 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd 1073741824" returned: 0 in 0.821s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:30 devstack sudo[102735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd
Jul 09 09:16:30 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:30 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd" returned: 0 in 0.658s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:16:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d567f2-6384-49b8-9029-9dc62224f2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9aaae8-bd09-43f8-ae8e-661466cbe31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:30 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Volume volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd (8df779da-3f7e-471f-b9b3-3b0d2451f4fd): created successfully
Jul 09 09:16:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9aaae8-bd09-43f8-ae8e-661466cbe31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Flow 'volume_create_manager' (b5e73e59-c858-4877-9136-f1b8648c7d88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:16:30 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a1427a55-8a43-4351-897c-b3651639eb14 tempest-VolumesListAdminTestJSON-280598216 None] Created volume successfully.
Jul 09 09:16:31 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:16:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Flow 'volume_create_manager' (f7843616-b267-4fb1-894e-eb28872e3980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:16:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b4756c-4618-46c5-a509-9b17920333cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b4756c-4618-46c5-a509-9b17920333cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcfbd043-2e98-45e2-b13d-3de3ad8116b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2bb1580e4744ae85f282a66e423e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:32Z,use_quota=True,user_id='dafbe63ab6ec401c9164be8a206b7560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b09e91c-fdf0-4a4c-8076-8823cdef3e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b09e91c-fdf0-4a4c-8076-8823cdef3e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2ca88c-2b8c-48b5-8fed-c367bac132cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2ca88c-2b8c-48b5-8fed-c367bac132cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcfbd043-2e98-45e2-b13d-3de3ad8116b7', 'volume_name': 'volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c0bfa9-8f4e-4597-aeb9-bc900ce42d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c0bfa9-8f4e-4597-aeb9-bc900ce42d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:31 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4deaac6-f15b-4fbb-ba1b-cfe7bebaa66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:31 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Volume fcfbd043-2e98-45e2-b13d-3de3ad8116b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7', 'volume_size': 1}
Jul 09 09:16:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcfbd043-2e98-45e2-b13d-3de3ad8116b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd2bb1580e4744ae85f282a66e423e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:32Z,use_quota=True,user_id='dafbe63ab6ec401c9164be8a206b7560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:16:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Creating volume fcfbd043-2e98-45e2-b13d-3de3ad8116b7 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:16:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:16:32 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:16:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:32 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7 1073741824
Jul 09 09:16:32 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:32 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7 1073741824" returned: 0 in 0.799s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:32 devstack sudo[102759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7
Jul 09 09:16:32 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:33 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-9d34d0d5-0f23-48ee-bf85-fed422f0ea1f req-4cd8c0b0-e0ba-414e-bd75-aac90d63df88 tempest-TestStampPattern-81593443 None] Terminate volume connection completed successfully.
Jul 09 09:16:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-9d34d0d5-0f23-48ee-bf85-fed422f0ea1f req-4cd8c0b0-e0ba-414e-bd75-aac90d63df88 tempest-TestStampPattern-81593443 None] Deleting attachment aaf9af4e-4138-40a3-a628-339c7f5b1092. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:16:33 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7" returned: 0 in 0.726s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:16:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4deaac6-f15b-4fbb-ba1b-cfe7bebaa66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca790b3e-298f-4c89-8754-4b1bfaea8b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:33 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Volume volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7 (fcfbd043-2e98-45e2-b13d-3de3ad8116b7): created successfully
Jul 09 09:16:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca790b3e-298f-4c89-8754-4b1bfaea8b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Flow 'volume_create_manager' (f7843616-b267-4fb1-894e-eb28872e3980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:16:33 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d685feea-9a3b-4953-8264-c5c358a93021 tempest-VolumesListAdminTestJSON-2121729964 None] Created volume successfully.
Jul 09 09:16:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Acquiring lock "cinder-fcfbd043-2e98-45e2-b13d-3de3ad8116b7-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Lock "cinder-fcfbd043-2e98-45e2-b13d-3de3ad8116b7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Acquiring lock "cinder-quobyte-fcfbd043-2e98-45e2-b13d-3de3ad8116b7" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Lock "cinder-quobyte-fcfbd043-2e98-45e2-b13d-3de3ad8116b7" acquired by "delete_volume" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:34 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[72954236-5dd6-4689-97bb-df179036f121]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:16:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "cinder-8df779da-3f7e-471f-b9b3-3b0d2451f4fd-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Lock "cinder-8df779da-3f7e-471f-b9b3-3b0d2451f4fd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "cinder-quobyte-8df779da-3f7e-471f-b9b3-3b0d2451f4fd" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Lock "cinder-quobyte-8df779da-3f7e-471f-b9b3-3b0d2451f4fd" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:34 devstack sudo[102795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7
Jul 09 09:16:34 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:34 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19757ab-c9ee-44bf-8aca-e20f0e358ad1]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:16:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:34 devstack sudo[102797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd
Jul 09 09:16:34 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:34 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7" returned: 0 in 0.814s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:35 devstack sudo[102802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7
Jul 09 09:16:35 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:35 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd" returned: 0 in 0.835s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:35 devstack sudo[102807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd
Jul 09 09:16:35 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:35 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcfbd043-2e98-45e2-b13d-3de3ad8116b7" returned: 0 in 0.703s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Lock "cinder-quobyte-fcfbd043-2e98-45e2-b13d-3de3ad8116b7" released by "delete_volume" :: held 1.565s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:35 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Created reservations ['648b13e1-1939-4217-8b03-3355d01a0047', '2ecba00b-53fe-4a36-b738-544e3a05ee5b', '6d33e14c-14d4-44b8-9c52-bf694ce0b739', '04092eb4-1ae8-459d-b6d5-5d2d4342e3f4'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:16:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:35 devstack sudo[102811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:16:35 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:35 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8df779da-3f7e-471f-b9b3-3b0d2451f4fd" returned: 0 in 0.731s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Lock "cinder-quobyte-8df779da-3f7e-471f-b9b3-3b0d2451f4fd" released by "delete_volume" :: held 1.619s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:35 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Created reservations ['14083e4f-a120-4034-9fc7-cc7077185988', 'be9f16d0-9858-4d38-a81d-84eddbeb677a', 'd537ff78-5f50-4b42-aa51-80ee0ea30f49', 'e2fa219a-1e7c-48b2-8afa-370eb66be494'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:36 devstack sudo[102815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:16:36 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "cinder-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Lock "cinder-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "cinder-quobyte-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Lock "cinder-quobyte-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c7829e-d40e-4545-8945-a0803cb6c038]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:36 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.863s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:16:36 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Deleted volume successfully.
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d781ac56-02d1-406c-916a-c806f47fbb87 tempest-VolumesListAdminTestJSON-2121729964 None] Lock "cinder-fcfbd043-2e98-45e2-b13d-3de3ad8116b7-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:36 devstack sudo[102818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e
Jul 09 09:16:36 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:36 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.887s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:16:36 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Deleted volume successfully.
Jul 09 09:16:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-08277253-a315-46bf-9938-37eb562d9dba tempest-VolumesListAdminTestJSON-280598216 None] Lock "cinder-8df779da-3f7e-471f-b9b3-3b0d2451f4fd-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:37 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e" returned: 0 in 0.879s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:37 devstack sudo[102829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e
Jul 09 09:16:37 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:38 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e" returned: 0 in 0.800s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Lock "cinder-quobyte-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e" released by "delete_volume" :: held 1.737s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:38 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Created reservations ['ffe4ee5c-c955-4756-8b4a-1175de7046b1', '27f2d76f-6a53-463c-961d-af5bb24a6875', '78961004-0b29-4ec8-8abd-a2b8fe6589fd', 'ffbd76b1-6516-49ca-b2a2-a95d5509bd45'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:16:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:38 devstack sudo[102850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:16:38 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "cinder-4e0bb973-351d-411b-8793-a820b153e8f3-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Lock "cinder-4e0bb973-351d-411b-8793-a820b153e8f3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "cinder-quobyte-4e0bb973-351d-411b-8793-a820b153e8f3" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Lock "cinder-quobyte-4e0bb973-351d-411b-8793-a820b153e8f3" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:39 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aca6c13-7dac-49d4-9296-892919917f7e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:16:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4e0bb973-351d-411b-8793-a820b153e8f3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:39 devstack sudo[102854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4e0bb973-351d-411b-8793-a820b153e8f3
Jul 09 09:16:39 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:39 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.714s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:39 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:16:39 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Deleted volume successfully.
Jul 09 09:16:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b100aab1-a271-4721-9a82-1733d250658b tempest-VolumesListAdminTestJSON-280598216 None] Lock "cinder-b2b713a2-ebb7-4c53-882c-4a2b08a5d25e-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:39 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4e0bb973-351d-411b-8793-a820b153e8f3" returned: 0 in 0.863s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4e0bb973-351d-411b-8793-a820b153e8f3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:39 devstack sudo[102862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4e0bb973-351d-411b-8793-a820b153e8f3
Jul 09 09:16:39 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:40 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4e0bb973-351d-411b-8793-a820b153e8f3" returned: 0 in 0.666s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Lock "cinder-quobyte-4e0bb973-351d-411b-8793-a820b153e8f3" released by "delete_volume" :: held 1.587s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:40 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Created reservations ['cc51ee8e-1666-4fb0-abf2-6ce9378a343f', 'fcc52b92-14b4-4054-95e2-2a3729816357', '21a675ce-a26b-43df-b4a8-e91a48aa6d72', '6f74af01-c1e6-43b1-999d-3dd3cadd6497'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:16:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:40 devstack sudo[102865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:16:40 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:41 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.677s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:41 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:16:41 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Deleted volume successfully.
Jul 09 09:16:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0663df64-7a7d-4823-b0f3-0f2c72bdbcaf tempest-VolumesListAdminTestJSON-280598216 None] Lock "cinder-4e0bb973-351d-411b-8793-a820b153e8f3-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Acquiring lock "cinder-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Lock "cinder-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Acquiring lock "cinder-quobyte-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Lock "cinder-quobyte-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:43 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6979712-b63e-4034-abf4-b343c70d95ed]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:16:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:43 devstack sudo[102869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd
Jul 09 09:16:43 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:44 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd" returned: 0 in 0.776s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:44 devstack sudo[102874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd
Jul 09 09:16:44 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:45 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd" returned: 0 in 0.653s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Lock "cinder-quobyte-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd" released by "delete_volume" :: held 1.472s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:45 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Created reservations ['f3c6d25a-0308-450e-8160-2b85644cc0af', '6837af76-2033-4a71-aa24-e05fe76ec812', 'b6102768-5849-4381-9a7b-87d38272946c', '0b47cbe7-2624-46aa-a6c8-0ea644eb3436'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:16:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:45 devstack sudo[102877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:16:45 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:46 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.676s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:46 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:16:46 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Deleted volume successfully.
Jul 09 09:16:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2d3529fb-61e3-4696-a723-c5514f5d0dd1 tempest-TestStampPattern-81593443 None] Lock "cinder-1ed62084-9dfa-4d8b-85eb-cdd6a21c63dd-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Acquiring lock "cinder-1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Lock "cinder-1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Acquiring lock "cinder-quobyte-bf5739ba-e703-4ffb-be54-0e69a62a9c10" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Lock "cinder-quobyte-bf5739ba-e703-4ffb-be54-0e69a62a9c10" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Acquiring lock "cinder-quobyte-1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Lock "cinder-quobyte-1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Deleting offline snapshot 1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc of volume bf5739ba-e703-4ffb-be54-0e69a62a9c10 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:16:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] snapshot_file for this snap is: volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:16:46 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cde83af-3bf3-4e4b-bcdf-f21f2fc2df5b]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:16:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:46 devstack sudo[102880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc
Jul 09 09:16:46 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:47 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc" returned: 0 in 0.774s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:16:47 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc5ac1c-b0ef-4229-8e13-10ba70f5ff29]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:16:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:47 devstack sudo[102885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10
Jul 09 09:16:47 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:47 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10" returned: 0 in 0.773s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:48 devstack sudo[102890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc
Jul 09 09:16:48 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:48 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc" returned: 0 in 0.743s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:48 devstack sudo[102895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc
Jul 09 09:16:48 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:49 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10.1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc" returned: 0 in 0.679s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:49 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Lock "cinder-quobyte-1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc" released by "_delete_snapshot" :: held 3.120s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:49 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Lock "cinder-quobyte-bf5739ba-e703-4ffb-be54-0e69a62a9c10" released by "delete_snapshot" :: held 3.146s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:49 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Created reservations ['84a7c717-855f-4492-aa87-c00dcb65f66a', 'f1f9b563-496b-4238-be0d-c7870025a4a0', '331a25f0-5e9f-4fdb-ad35-813ae3b51bf4', 'd1543ffb-0ac6-4ca4-b294-fbfd18cb639c'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:16:49 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Delete snapshot completed successfully.
Jul 09 09:16:49 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-999f3bfd-5588-4401-a8b7-e1643af19f58 tempest-TestStampPattern-81593443 None] Lock "cinder-1fcd7ff9-fc58-4cdb-8afb-ab33dc87d2dc-delete_snapshot" released by "delete_snapshot" :: held 3.283s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Flow 'volume_create_manager' (f0ba7d26-ac05-4cbe-80cb-536c3cb46f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b3db26-aa0b-4b26-a2ab-6020890f753b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b3db26-aa0b-4b26-a2ab-6020890f753b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1968959549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f91428f7-190d-4734-84b9-4f99022a1fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3116a1ac52904d7a9128ca1805d5a493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:51Z,use_quota=True,user_id='0ac7423d3f5041c3915757bf100831be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d2f1f9-c934-406b-aece-c54137ea9e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d2f1f9-c934-406b-aece-c54137ea9e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23528de2-3867-4403-8779-4082aac8f0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23528de2-3867-4403-8779-4082aac8f0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f91428f7-190d-4734-84b9-4f99022a1fbe', 'volume_name': 'volume-f91428f7-190d-4734-84b9-4f99022a1fbe', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f319609-ac57-4cbb-a626-37a6a3b83d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f319609-ac57-4cbb-a626-37a6a3b83d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7514b5-524d-49ad-93e0-cd0ca1d3bf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:51 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Volume f91428f7-190d-4734-84b9-4f99022a1fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f91428f7-190d-4734-84b9-4f99022a1fbe', 'volume_size': 1}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1968959549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f91428f7-190d-4734-84b9-4f99022a1fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3116a1ac52904d7a9128ca1805d5a493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:51Z,use_quota=True,user_id='0ac7423d3f5041c3915757bf100831be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Creating volume f91428f7-190d-4734-84b9-4f99022a1fbe {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:16:51 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:16:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f91428f7-190d-4734-84b9-4f99022a1fbe 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:51 devstack sudo[102902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f91428f7-190d-4734-84b9-4f99022a1fbe 1073741824
Jul 09 09:16:51 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:52 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f91428f7-190d-4734-84b9-4f99022a1fbe 1073741824" returned: 0 in 0.909s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f91428f7-190d-4734-84b9-4f99022a1fbe {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:52 devstack sudo[102910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f91428f7-190d-4734-84b9-4f99022a1fbe
Jul 09 09:16:52 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:53 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f91428f7-190d-4734-84b9-4f99022a1fbe" returned: 0 in 0.638s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:16:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7514b5-524d-49ad-93e0-cd0ca1d3bf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f91428f7-190d-4734-84b9-4f99022a1fbe', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4590fce-b98a-487c-b6d2-c6e20d69da15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:53 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Volume volume-f91428f7-190d-4734-84b9-4f99022a1fbe (f91428f7-190d-4734-84b9-4f99022a1fbe): created successfully
Jul 09 09:16:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4590fce-b98a-487c-b6d2-c6e20d69da15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Flow 'volume_create_manager' (f0ba7d26-ac05-4cbe-80cb-536c3cb46f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:16:53 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e0796264-e0ad-455b-aaf2-12ca74850b34 tempest-VolumesTransfersTest-942967590 None] Created volume successfully.
Jul 09 09:16:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:16:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:54 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-dffeffbd-1152-4250-94b4-e014c355e3f8 tempest-VolumesTransfersTest-711846540 None] Transfer volume completed successfully.
Jul 09 09:16:54 devstack sudo[102934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:16:54 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:54 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.705s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:54 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:16:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:16:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:16:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:16:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Acquiring lock "cinder-f91428f7-190d-4734-84b9-4f99022a1fbe-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Lock "cinder-f91428f7-190d-4734-84b9-4f99022a1fbe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Acquiring lock "cinder-quobyte-f91428f7-190d-4734-84b9-4f99022a1fbe" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Lock "cinder-quobyte-f91428f7-190d-4734-84b9-4f99022a1fbe" acquired by "delete_volume" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:55 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d7368d-8c4f-4b87-863d-560dfd0140a0]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:16:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f91428f7-190d-4734-84b9-4f99022a1fbe {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:55 devstack sudo[102938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f91428f7-190d-4734-84b9-4f99022a1fbe
Jul 09 09:16:55 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:55 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f91428f7-190d-4734-84b9-4f99022a1fbe" returned: 0 in 0.775s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f91428f7-190d-4734-84b9-4f99022a1fbe {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:55 devstack sudo[102943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f91428f7-190d-4734-84b9-4f99022a1fbe
Jul 09 09:16:55 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:56 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-f91428f7-190d-4734-84b9-4f99022a1fbe" returned: 0 in 0.651s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Lock "cinder-quobyte-f91428f7-190d-4734-84b9-4f99022a1fbe" released by "delete_volume" :: held 1.463s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:56 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Created reservations ['3651f2ee-194d-406d-b4b7-7d2e4d2b2f3a', '937e209c-84dc-4441-8541-2c91dad6d264', '4348fb48-ea62-4101-b221-9527cc5d105c', '721253ac-2053-42d0-aea1-d0e4ca1b4352'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:16:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:56 devstack sudo[102946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:16:56 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:57 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.643s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:16:57 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Deleted volume successfully.
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f81d7f5d-c59b-4800-a3a1-f2ccc9c12ba9 tempest-VolumesTransfersTest-74420704 None] Lock "cinder-f91428f7-190d-4734-84b9-4f99022a1fbe-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Acquiring lock "cinder-bf5739ba-e703-4ffb-be54-0e69a62a9c10-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Lock "cinder-bf5739ba-e703-4ffb-be54-0e69a62a9c10-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Acquiring lock "cinder-quobyte-bf5739ba-e703-4ffb-be54-0e69a62a9c10" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Lock "cinder-quobyte-bf5739ba-e703-4ffb-be54-0e69a62a9c10" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Flow 'volume_create_manager' (b3fd2730-d731-4561-8c3c-64d4e790443f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d940387-b377-4804-a52a-16d3fa1f7161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e685233-99d9-45a6-a511-117e3c1a2e80]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d940387-b377-4804-a52a-16d3fa1f7161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1202696668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbd15be-f48b-4441-8afc-9d2a640ee3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3116a1ac52904d7a9128ca1805d5a493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:58Z,use_quota=True,user_id='0ac7423d3f5041c3915757bf100831be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca848a0-9e8e-4a78-8f90-d475acc21cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca848a0-9e8e-4a78-8f90-d475acc21cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ff32c7-76b8-43d5-a1d6-ca4b26de55a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ff32c7-76b8-43d5-a1d6-ca4b26de55a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffbd15be-f48b-4441-8afc-9d2a640ee3dc', 'volume_name': 'volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793815b3-c8d9-4b05-98c4-42aa56f5adef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793815b3-c8d9-4b05-98c4-42aa56f5adef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd679f0-ad3e-46e4-ac88-f952931b9bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:57 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Volume ffbd15be-f48b-4441-8afc-9d2a640ee3dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc', 'volume_size': 1}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1202696668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffbd15be-f48b-4441-8afc-9d2a640ee3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3116a1ac52904d7a9128ca1805d5a493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:16:58Z,use_quota=True,user_id='0ac7423d3f5041c3915757bf100831be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Creating volume ffbd15be-f48b-4441-8afc-9d2a640ee3dc {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:16:57 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:16:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:57 devstack sudo[102950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc 1073741824
Jul 09 09:16:57 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:57 devstack sudo[102949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10
Jul 09 09:16:57 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:58 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10" returned: 0 in 0.772s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:58 devstack sudo[102959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10
Jul 09 09:16:58 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:58 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc 1073741824" returned: 0 in 0.836s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:58 devstack sudo[102961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc
Jul 09 09:16:58 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:59 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bf5739ba-e703-4ffb-be54-0e69a62a9c10" returned: 0 in 0.671s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Lock "cinder-quobyte-bf5739ba-e703-4ffb-be54-0e69a62a9c10" released by "delete_volume" :: held 1.537s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Created reservations ['0a055f5f-6c21-4ff6-b344-971c7cbcb932', 'a5215a18-ccd6-43b5-aa3b-5c838541e96d', '01c1415f-e4bb-4270-acde-58a78d5ec69d', 'ee2cf5e3-b9c5-4fec-a659-5f5224f560c7'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:16:59 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc" returned: 0 in 0.639s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd679f0-ad3e-46e4-ac88-f952931b9bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5acca5-4ef2-4b2e-935c-ca97461f3f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:16:59 devstack sudo[102966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:16:59 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:16:59 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Volume volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc (ffbd15be-f48b-4441-8afc-9d2a640ee3dc): created successfully
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5acca5-4ef2-4b2e-935c-ca97461f3f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:16:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Flow 'volume_create_manager' (b3fd2730-d731-4561-8c3c-64d4e790443f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:16:59 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-54f8fa13-a1b2-41a5-8fab-294bdc384cb3 tempest-VolumesTransfersTest-942967590 None] Created volume successfully.
Jul 09 09:17:00 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.650s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:00 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:17:00 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Deleted volume successfully.
Jul 09 09:17:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d937a9c9-b147-4ff7-b670-797429fbbda2 tempest-TestStampPattern-81593443 None] Lock "cinder-bf5739ba-e703-4ffb-be54-0e69a62a9c10-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Acquiring lock "cinder-ffbd15be-f48b-4441-8afc-9d2a640ee3dc-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Lock "cinder-ffbd15be-f48b-4441-8afc-9d2a640ee3dc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Acquiring lock "cinder-quobyte-ffbd15be-f48b-4441-8afc-9d2a640ee3dc" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Lock "cinder-quobyte-ffbd15be-f48b-4441-8afc-9d2a640ee3dc" acquired by "delete_volume" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:00 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f41abcf-b5a6-439c-9a67-7c586acc277a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:00 devstack sudo[102969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc
Jul 09 09:17:00 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:01 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc" returned: 0 in 0.811s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:01 devstack sudo[102975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc
Jul 09 09:17:01 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:01 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ffbd15be-f48b-4441-8afc-9d2a640ee3dc" returned: 0 in 0.711s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Lock "cinder-quobyte-ffbd15be-f48b-4441-8afc-9d2a640ee3dc" released by "delete_volume" :: held 1.568s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:01 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Created reservations ['a20f38f2-bd60-490c-a089-c191192a8589', '2a8451ec-7805-423f-9970-96de82d8ced7', 'c65901b8-b3ad-4be4-8ad0-ae8309eed249', '7874ef3e-c012-4107-874c-50ee062abab0'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:17:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:17:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:17:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:02 devstack sudo[102983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:17:02 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:02 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.678s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:02 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:17:02 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Deleted volume successfully.
Jul 09 09:17:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-31790dcb-3df4-4862-b390-cca75984453b tempest-VolumesTransfersTest-74420704 None] Lock "cinder-ffbd15be-f48b-4441-8afc-9d2a640ee3dc-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Flow 'volume_create_manager' (c5d3b0d7-b9fa-4909-a776-4f229e91ea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6764e819-1e1a-4b17-8f1d-7bf547d8b595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6764e819-1e1a-4b17-8f1d-7bf547d8b595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1754620170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336b87c5-b637-43a6-a56a-594cd3d65884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05cf3596df584a2fbd9d21e16ebec2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:17:08Z,use_quota=True,user_id='65df77c16f0840698debf2add999f62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f24fb4-2d29-4458-b374-a9f0821c7881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f24fb4-2d29-4458-b374-a9f0821c7881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cc82b7-9cf5-476a-8b16-319ad2630c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cc82b7-9cf5-476a-8b16-319ad2630c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '336b87c5-b637-43a6-a56a-594cd3d65884', 'volume_name': 'volume-336b87c5-b637-43a6-a56a-594cd3d65884', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12db3ba4-86d9-466a-ae82-a539d3f2fdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12db3ba4-86d9-466a-ae82-a539d3f2fdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ec5de4-0379-40db-beb4-e1478c3c1bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:08 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Volume 336b87c5-b637-43a6-a56a-594cd3d65884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-336b87c5-b637-43a6-a56a-594cd3d65884', 'volume_size': 1}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1754620170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336b87c5-b637-43a6-a56a-594cd3d65884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05cf3596df584a2fbd9d21e16ebec2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:17:08Z,use_quota=True,user_id='65df77c16f0840698debf2add999f62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Creating volume 336b87c5-b637-43a6-a56a-594cd3d65884 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:17:08 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:17:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:08 devstack sudo[102990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884 1073741824
Jul 09 09:17:08 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:09 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884 1073741824" returned: 0 in 0.909s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:09 devstack sudo[102997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884
Jul 09 09:17:09 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:09 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884" returned: 0 in 0.665s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:17:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ec5de4-0379-40db-beb4-e1478c3c1bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336b87c5-b637-43a6-a56a-594cd3d65884', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a52f8dd-78e4-4d0e-b85b-b7bb534f9148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:10 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Volume volume-336b87c5-b637-43a6-a56a-594cd3d65884 (336b87c5-b637-43a6-a56a-594cd3d65884): created successfully
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a52f8dd-78e4-4d0e-b85b-b7bb534f9148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Flow 'volume_create_manager' (c5d3b0d7-b9fa-4909-a776-4f229e91ea4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:17:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d0e1f0f9-17db-41ad-8045-f989af73580f tempest-VolumesCloneTest-592067416 None] Created volume successfully.
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Flow 'volume_create_manager' (16e72325-0c88-458a-87ab-7d3aafbf1e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e984b68-70c2-4796-8796-ae6bfb326263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e984b68-70c2-4796-8796-ae6bfb326263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1292204919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6adf8ccb-4873-49de-a8a3-3fbcd0259783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05cf3596df584a2fbd9d21e16ebec2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:17:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=336b87c5-b637-43a6-a56a-594cd3d65884,status='creating',terminated_at=None,updated_at=2026-07-09T07:17:11Z,use_quota=True,user_id='65df77c16f0840698debf2add999f62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2cd693-09fb-4814-bf68-c3451ea2e945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2cd693-09fb-4814-bf68-c3451ea2e945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca83aadf-0d71-4ea2-8702-83fb25b81425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca83aadf-0d71-4ea2-8702-83fb25b81425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6adf8ccb-4873-49de-a8a3-3fbcd0259783', 'volume_name': 'volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783', 'volume_size': 2, 'source_volid': '336b87c5-b637-43a6-a56a-594cd3d65884', 'source_volstatus': 'available'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b9710d-e157-485d-b2a9-f0b637b72787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b9710d-e157-485d-b2a9-f0b637b72787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620df609-3521-4c7c-b650-f1193ab01a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:10 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Volume 6adf8ccb-4873-49de-a8a3-3fbcd0259783: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783', 'volume_size': 2, 'source_volid': '336b87c5-b637-43a6-a56a-594cd3d65884', 'source_volstatus': 'available'}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:10 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Cloning volume 336b87c5-b637-43a6-a56a-594cd3d65884 to volume 6adf8ccb-4873-49de-a8a3-3fbcd0259783
Jul 09 09:17:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Creating offline snapshot fd0ddd26-b06c-4c64-8a12-1aa677afc2d5 of volume 336b87c5-b637-43a6-a56a-594cd3d65884 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[08114437-de71-4ccf-9b65-7263f8ad2a80]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:11 devstack sudo[103000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884
Jul 09 09:17:11 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Flow 'volume_create_manager' (32c003cf-feec-4da1-9182-5579f538f604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cddd474-d548-4cf6-9260-1bafe8cbc42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cddd474-d548-4cf6-9260-1bafe8cbc42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9cff932-b7c6-4d1f-9887-52ee766829b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a18ee202aa4410ca7951d7404e3d008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:17:12Z,use_quota=True,user_id='46d218fb3d424bef98e79c9d491f855a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4933f60-fca8-44c1-b155-d6037b6efdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4933f60-fca8-44c1-b155-d6037b6efdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda78587-b3f5-45cf-a3d7-fcb2d66ec02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda78587-b3f5-45cf-a3d7-fcb2d66ec02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9cff932-b7c6-4d1f-9887-52ee766829b2', 'volume_name': 'volume-a9cff932-b7c6-4d1f-9887-52ee766829b2', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b421cf12-8a97-4580-8db8-c07d221a932e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b421cf12-8a97-4580-8db8-c07d221a932e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e90587f-c411-4c97-8dc3-04dfe0867764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:11 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Volume a9cff932-b7c6-4d1f-9887-52ee766829b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9cff932-b7c6-4d1f-9887-52ee766829b2', 'volume_size': 1}
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:11 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884" returned: 0 in 0.796s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:11 devstack sudo[103005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5 1G
Jul 09 09:17:11 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:12 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5 1G" returned: 0 in 0.846s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336b87c5-b637-43a6-a56a-594cd3d65884 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:12 devstack sudo[103011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336b87c5-b637-43a6-a56a-594cd3d65884 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5
Jul 09 09:17:12 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:13 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-336b87c5-b637-43a6-a56a-594cd3d65884 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5" returned: 0 in 0.679s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:13 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5 is being set with open permissions: ugo+rw
Jul 09 09:17:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:13 devstack sudo[103016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5
Jul 09 09:17:13 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:13 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5" returned: 0 in 0.645s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:14 devstack sudo[103019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.info
Jul 09 09:17:14 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:14 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.info" returned: 0 in 0.636s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:14 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.info is being set with open permissions: ugo+rw
Jul 09 09:17:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:14 devstack sudo[103022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.info
Jul 09 09:17:14 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:15 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.info" returned: 0 in 0.664s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:15 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Acquiring lock "cinder-quobyte-6adf8ccb-4873-49de-a8a3-3fbcd0259783" by "_copy_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:15 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Lock "cinder-quobyte-6adf8ccb-4873-49de-a8a3-3fbcd0259783" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] snapshot: fd0ddd26-b06c-4c64-8a12-1aa677afc2d5, volume: 6adf8ccb-4873-49de-a8a3-3fbcd0259783,  {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 09:17:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:17:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:17:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:15 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[106c7e9a-9f40-403e-a8c1-800fa9eafb1c]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:15 devstack sudo[103025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5
Jul 09 09:17:15 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:16 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5" returned: 0 in 0.740s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-336b87c5-b637-43a6-a56a-594cd3d65884(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:17:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] will copy from snapshot at /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884 {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 09:17:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Creating direct copy from snapshot {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 09:17:16 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31867b6-2749-4556-95d9-dee3702f663f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:16 devstack sudo[103030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884
Jul 09 09:17:16 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:16 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884" returned: 0 in 0.763s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:16 devstack cinder-volume[87009]: DEBUG cinder.utils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Path /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783 not found in is_blk_device check {{(pid=87009) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 09:17:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:16 devstack sudo[103035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783
Jul 09 09:17:16 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:21 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783" returned: 0 in 4.404s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:21 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a830ff9-4a0e-4398-b62d-639299b5ad1b]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:21 devstack sudo[103050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884
Jul 09 09:17:21 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:22 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884" returned: 0 in 0.878s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:22 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Image conversion details: src /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884, size 1024.00 MB, duration 4.40 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783 {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:17:22 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Converted 1024.00 MB image at 232.48 MB/s
Jul 09 09:17:22 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783 is being set with open permissions: ugo+rw
Jul 09 09:17:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:22 devstack sudo[103055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783
Jul 09 09:17:22 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:22 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783" returned: 0 in 0.651s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Lock "cinder-quobyte-6adf8ccb-4873-49de-a8a3-3fbcd0259783" released by "_copy_volume_from_snapshot" :: held 7.512s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:22 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=85,cinder:SELECT=72,cinder:INSERT=24,cinder:DELETE=5 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:17:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Acquiring lock "cinder-quobyte-fd0ddd26-b06c-4c64-8a12-1aa677afc2d5" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Lock "cinder-quobyte-fd0ddd26-b06c-4c64-8a12-1aa677afc2d5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:22 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Deleting offline snapshot fd0ddd26-b06c-4c64-8a12-1aa677afc2d5 of volume 336b87c5-b637-43a6-a56a-594cd3d65884 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:17:22 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] snapshot_file for this snap is: volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:17:22 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[30937b95-4dab-422f-9d52-3498d9188443]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:23 devstack sudo[103060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5
Jul 09 09:17:23 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:23 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5" returned: 0 in 0.747s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-336b87c5-b637-43a6-a56a-594cd3d65884(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:17:23 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b1e068-0b95-4b5d-ad16-66cd63970a4f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:23 devstack sudo[103065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884
Jul 09 09:17:23 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:23 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=71,cinder:INSERT=21,cinder:UPDATE=103,cinder:DELETE=10 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:17:24 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884" returned: 0 in 0.747s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:24 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5
Jul 09 09:17:24 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:25 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5" returned: 0 in 0.722s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:25 devstack sudo[103112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5
Jul 09 09:17:25 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:25 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884.fd0ddd26-b06c-4c64-8a12-1aa677afc2d5" returned: 0 in 0.622s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Lock "cinder-quobyte-fd0ddd26-b06c-4c64-8a12-1aa677afc2d5" released by "_delete_snapshot" :: held 2.923s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.883s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.082s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9cff932-b7c6-4d1f-9887-52ee766829b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a18ee202aa4410ca7951d7404e3d008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:17:12Z,use_quota=True,user_id='46d218fb3d424bef98e79c9d491f855a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Creating volume a9cff932-b7c6-4d1f-9887-52ee766829b2 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:17:25 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a9cff932-b7c6-4d1f-9887-52ee766829b2 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:25 devstack sudo[103115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a9cff932-b7c6-4d1f-9887-52ee766829b2 1073741824
Jul 09 09:17:25 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620df609-3521-4c7c-b650-f1193ab01a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783', 'volume_size': 2, 'source_volid': '336b87c5-b637-43a6-a56a-594cd3d65884', 'source_volstatus': 'available'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56996a7-58c6-4117-b033-ef9266e92772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:25 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Volume volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783 (6adf8ccb-4873-49de-a8a3-3fbcd0259783): created successfully
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56996a7-58c6-4117-b033-ef9266e92772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Flow 'volume_create_manager' (16e72325-0c88-458a-87ab-7d3aafbf1e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:17:25 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-8235406c-8c2d-445f-83d8-eca9e94717e7 tempest-VolumesCloneTest-592067416 None] Created volume successfully.
Jul 09 09:17:26 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a9cff932-b7c6-4d1f-9887-52ee766829b2 1073741824" returned: 0 in 0.809s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a9cff932-b7c6-4d1f-9887-52ee766829b2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:26 devstack sudo[103120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a9cff932-b7c6-4d1f-9887-52ee766829b2
Jul 09 09:17:26 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Acquiring lock "cinder-6adf8ccb-4873-49de-a8a3-3fbcd0259783-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Lock "cinder-6adf8ccb-4873-49de-a8a3-3fbcd0259783-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Acquiring lock "cinder-quobyte-6adf8ccb-4873-49de-a8a3-3fbcd0259783" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Lock "cinder-quobyte-6adf8ccb-4873-49de-a8a3-3fbcd0259783" acquired by "delete_volume" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[915d6de5-6355-4ed7-8db2-2ceb9cda4ef6]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:27 devstack sudo[103122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783
Jul 09 09:17:27 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:27 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a9cff932-b7c6-4d1f-9887-52ee766829b2" returned: 0 in 0.647s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e90587f-c411-4c97-8dc3-04dfe0867764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9cff932-b7c6-4d1f-9887-52ee766829b2', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfa5327-f9fa-4b95-8ba9-429b5612eac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:27 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Volume volume-a9cff932-b7c6-4d1f-9887-52ee766829b2 (a9cff932-b7c6-4d1f-9887-52ee766829b2): created successfully
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfa5327-f9fa-4b95-8ba9-429b5612eac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Flow 'volume_create_manager' (32c003cf-feec-4da1-9182-5579f538f604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:17:27 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-97d4a792-14d9-4f38-a859-b7c24e074279 tempest-CinderUnicodeTest-1254913375 None] Created volume successfully.
Jul 09 09:17:27 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783" returned: 0 in 0.765s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:27 devstack sudo[103128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783
Jul 09 09:17:27 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Flow 'volume_create_manager' (15c706f5-1453-4f2f-a1b7-4cad3bad462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733430be-a0cb-48c3-a099-1535cfe7dacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733430be-a0cb-48c3-a099-1535cfe7dacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:17:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-874309675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b77de8-7bfc-433f-9713-dc2fe84d5a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a18ee202aa4410ca7951d7404e3d008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:17:28Z,use_quota=True,user_id='46d218fb3d424bef98e79c9d491f855a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9588315-4e5f-4ddb-90d4-7cf1966f99ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9588315-4e5f-4ddb-90d4-7cf1966f99ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff48f8d3-6f89-46a7-8c26-1dda8b96538f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff48f8d3-6f89-46a7-8c26-1dda8b96538f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b77de8-7bfc-433f-9713-dc2fe84d5a43', 'volume_name': 'volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e7f891-f797-4160-8667-820a2c44e8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e7f891-f797-4160-8667-820a2c44e8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43e87de-c164-4355-9fda-12814194bd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:28 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Volume c6b77de8-7bfc-433f-9713-dc2fe84d5a43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43', 'volume_size': 1}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:17:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-874309675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b77de8-7bfc-433f-9713-dc2fe84d5a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a18ee202aa4410ca7951d7404e3d008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:17:28Z,use_quota=True,user_id='46d218fb3d424bef98e79c9d491f855a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Creating volume c6b77de8-7bfc-433f-9713-dc2fe84d5a43 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:17:28 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:28 devstack sudo[103130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43 1073741824
Jul 09 09:17:28 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:28 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6adf8ccb-4873-49de-a8a3-3fbcd0259783" returned: 0 in 0.666s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Lock "cinder-quobyte-6adf8ccb-4873-49de-a8a3-3fbcd0259783" released by "delete_volume" :: held 1.470s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Created reservations ['986ba4ed-3390-4968-9b6e-a8d120e1bc26', 'c8e1a6d7-1671-4784-a26d-7ec87056bf37', 'afb51062-dc70-4ced-9a3b-facd4d52971a', '5420eacf-ffe4-46f3-ab5e-5cdd5e4e83a7'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:28 devstack sudo[103133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:17:28 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:29 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43 1073741824" returned: 0 in 0.829s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:29 devstack sudo[103138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43
Jul 09 09:17:29 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Acquiring lock "cinder-336b87c5-b637-43a6-a56a-594cd3d65884-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Lock "cinder-336b87c5-b637-43a6-a56a-594cd3d65884-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Acquiring lock "cinder-quobyte-336b87c5-b637-43a6-a56a-594cd3d65884" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Lock "cinder-quobyte-336b87c5-b637-43a6-a56a-594cd3d65884" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:29 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.744s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:17:29 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Deleted volume successfully.
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7ac55a-0c79-4b28-9a81-44afb286bb0f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fe97d86e-db58-4f69-b5cc-4bd37e94598a tempest-VolumesCloneTest-592067416 None] Lock "cinder-6adf8ccb-4873-49de-a8a3-3fbcd0259783-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:29 devstack sudo[103142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884
Jul 09 09:17:29 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:29 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43" returned: 0 in 0.665s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43e87de-c164-4355-9fda-12814194bd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b895ee-95ee-4614-a8d0-239222960aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:29 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Volume volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43 (c6b77de8-7bfc-433f-9713-dc2fe84d5a43): created successfully
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b895ee-95ee-4614-a8d0-239222960aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Flow 'volume_create_manager' (15c706f5-1453-4f2f-a1b7-4cad3bad462f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:17:29 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-275b01f7-71c9-4fc7-9931-7968ff4562d0 tempest-CinderUnicodeTest-1254913375 None] Created volume successfully.
Jul 09 09:17:30 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884" returned: 0 in 0.785s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:30 devstack sudo[103148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884
Jul 09 09:17:30 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] Creating offline snapshot f6c719c3-26b4-4bd8-870f-a11c9293fa9c of volume c6b77de8-7bfc-433f-9713-dc2fe84d5a43 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:17:30 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ea5d17-550c-4640-a483-62a06aff55ff]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:30 devstack sudo[103150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43
Jul 09 09:17:30 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:30 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-336b87c5-b637-43a6-a56a-594cd3d65884" returned: 0 in 0.666s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:30 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Lock "cinder-quobyte-336b87c5-b637-43a6-a56a-594cd3d65884" released by "delete_volume" :: held 1.524s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:30 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Created reservations ['2fc27cf1-760e-4ecb-8903-f92c6d398daf', '1b48aced-bbac-4857-97c4-e48150d7048e', '74f5ce6c-fc96-48c8-9f84-fc081f1c4328', 'ef2d1b47-3495-453c-9825-68cf8473841e'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:17:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:17:31 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:17:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:31 devstack sudo[103153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:17:31 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:31 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43" returned: 0 in 0.752s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:31 devstack sudo[103158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c 1G
Jul 09 09:17:31 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:31 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.662s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:31 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:17:31 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Deleted volume successfully.
Jul 09 09:17:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88f0c81c-e7e2-4f31-b927-720964e4e95e tempest-VolumesCloneTest-592067416 None] Lock "cinder-336b87c5-b637-43a6-a56a-594cd3d65884-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:32 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c 1G" returned: 0 in 0.810s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:32 devstack sudo[103164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c
Jul 09 09:17:32 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:32 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c" returned: 0 in 0.717s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:32 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c is being set with open permissions: ugo+rw
Jul 09 09:17:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:32 devstack sudo[103170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c
Jul 09 09:17:32 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:33 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c" returned: 0 in 0.647s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:33 devstack sudo[103179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.info
Jul 09 09:17:33 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:34 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.info" returned: 0 in 0.693s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:34 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.info is being set with open permissions: ugo+rw
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:34 devstack sudo[103182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.info
Jul 09 09:17:34 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Flow 'volume_create_manager' (ec7d574b-752b-4863-8604-66a2f2e45647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8091e48-5edf-4342-8c15-31ebf7e6091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8091e48-5edf-4342-8c15-31ebf7e6091e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-378954010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227f0705-26d8-4517-83bc-990f3d70ac96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e060acd5c645f89c2d0b57d04e2f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:17:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:17:34Z,use_quota=True,user_id='acc99f0cabb44fb79e82021bef43513c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf11f56-34e7-4c49-b8c2-5ab20c4517c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf11f56-34e7-4c49-b8c2-5ab20c4517c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d19eb16-8cce-4473-8ac0-123d7b33ac5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d19eb16-8cce-4473-8ac0-123d7b33ac5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '227f0705-26d8-4517-83bc-990f3d70ac96', 'volume_name': 'volume-227f0705-26d8-4517-83bc-990f3d70ac96', 'volume_size': 2}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0613fe2c-a8e0-4ae2-b1b5-fe22b477df3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0613fe2c-a8e0-4ae2-b1b5-fe22b477df3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa175e8-d8e3-4724-8e38-4f1ab4c3fe76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:34 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Volume 227f0705-26d8-4517-83bc-990f3d70ac96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-227f0705-26d8-4517-83bc-990f3d70ac96', 'volume_size': 2}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:34 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.info" returned: 0 in 0.626s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.356s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-378954010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227f0705-26d8-4517-83bc-990f3d70ac96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e060acd5c645f89c2d0b57d04e2f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:17:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:17:34Z,use_quota=True,user_id='acc99f0cabb44fb79e82021bef43513c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Creating volume 227f0705-26d8-4517-83bc-990f3d70ac96 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:17:34 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:17:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-227f0705-26d8-4517-83bc-990f3d70ac96 2147483648 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:34 devstack sudo[103185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-227f0705-26d8-4517-83bc-990f3d70ac96 2147483648
Jul 09 09:17:34 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:34 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-9744df06-2b18-4eb9-a857-aab6a96b621f tempest-CinderUnicodeTest-1254913375 None] Create snapshot completed successfully
Jul 09 09:17:35 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-227f0705-26d8-4517-83bc-990f3d70ac96 2147483648" returned: 0 in 0.834s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-227f0705-26d8-4517-83bc-990f3d70ac96 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Acquiring lock "cinder-f6c719c3-26b4-4bd8-870f-a11c9293fa9c-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:35 devstack sudo[103191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-227f0705-26d8-4517-83bc-990f3d70ac96
Jul 09 09:17:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Lock "cinder-f6c719c3-26b4-4bd8-870f-a11c9293fa9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Acquiring lock "cinder-quobyte-c6b77de8-7bfc-433f-9713-dc2fe84d5a43" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:35 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Lock "cinder-quobyte-c6b77de8-7bfc-433f-9713-dc2fe84d5a43" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Acquiring lock "cinder-quobyte-f6c719c3-26b4-4bd8-870f-a11c9293fa9c" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Lock "cinder-quobyte-f6c719c3-26b4-4bd8-870f-a11c9293fa9c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Deleting offline snapshot f6c719c3-26b4-4bd8-870f-a11c9293fa9c of volume c6b77de8-7bfc-433f-9713-dc2fe84d5a43 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:17:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] snapshot_file for this snap is: volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:17:35 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[134b7dd7-58e7-43df-a6a5-f902d97a9771]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:35 devstack sudo[103193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c
Jul 09 09:17:35 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:36 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-227f0705-26d8-4517-83bc-990f3d70ac96" returned: 0 in 0.659s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:17:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa175e8-d8e3-4724-8e38-4f1ab4c3fe76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-227f0705-26d8-4517-83bc-990f3d70ac96', 'volume_size': 2}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35994f7c-e12a-44b7-81da-f5f348481473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:36 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Volume volume-227f0705-26d8-4517-83bc-990f3d70ac96 (227f0705-26d8-4517-83bc-990f3d70ac96): created successfully
Jul 09 09:17:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35994f7c-e12a-44b7-81da-f5f348481473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Flow 'volume_create_manager' (ec7d574b-752b-4863-8604-66a2f2e45647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:17:36 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-acd23ae5-6e0a-43d7-9dff-c77874e6155d tempest-VolumesCloneNegativeTest-715434734 None] Created volume successfully.
Jul 09 09:17:36 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c" returned: 0 in 0.772s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:17:36 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6657ba91-8cde-4611-aad0-231380adf800]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:36 devstack sudo[103199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43
Jul 09 09:17:36 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:37 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43" returned: 0 in 0.754s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:37 devstack sudo[103204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c
Jul 09 09:17:37 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Acquiring lock "cinder-227f0705-26d8-4517-83bc-990f3d70ac96-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Lock "cinder-227f0705-26d8-4517-83bc-990f3d70ac96-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Acquiring lock "cinder-quobyte-227f0705-26d8-4517-83bc-990f3d70ac96" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Lock "cinder-quobyte-227f0705-26d8-4517-83bc-990f3d70ac96" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:37 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e898645b-5412-424e-8353-94799b07fa45]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-227f0705-26d8-4517-83bc-990f3d70ac96 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:37 devstack sudo[103206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-227f0705-26d8-4517-83bc-990f3d70ac96
Jul 09 09:17:37 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:38 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c" returned: 0 in 0.754s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:38 devstack sudo[103211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c
Jul 09 09:17:38 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:38 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-227f0705-26d8-4517-83bc-990f3d70ac96" returned: 0 in 0.787s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-227f0705-26d8-4517-83bc-990f3d70ac96 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:38 devstack sudo[103216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-227f0705-26d8-4517-83bc-990f3d70ac96
Jul 09 09:17:38 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:38 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43.f6c719c3-26b4-4bd8-870f-a11c9293fa9c" returned: 0 in 0.684s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Lock "cinder-quobyte-f6c719c3-26b4-4bd8-870f-a11c9293fa9c" released by "_delete_snapshot" :: held 3.067s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Lock "cinder-quobyte-c6b77de8-7bfc-433f-9713-dc2fe84d5a43" released by "delete_snapshot" :: held 3.088s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:38 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Created reservations ['e8d28a3c-0a5d-4789-9dcb-926185783673', '6c03608a-05ee-47d2-9743-a995259b016f', 'd9af944a-e3a1-4f50-91ce-c2e09928c8e4', 'f3a77a76-0a37-4a78-8945-73c5cef4c716'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:17:38 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Delete snapshot completed successfully.
Jul 09 09:17:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f1b7171e-ef67-4877-9256-6bb20beea5f5 tempest-CinderUnicodeTest-1254913375 None] Lock "cinder-f6c719c3-26b4-4bd8-870f-a11c9293fa9c-delete_snapshot" released by "delete_snapshot" :: held 3.209s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:39 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-227f0705-26d8-4517-83bc-990f3d70ac96" returned: 0 in 0.636s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Lock "cinder-quobyte-227f0705-26d8-4517-83bc-990f3d70ac96" released by "delete_volume" :: held 1.459s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:39 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Created reservations ['71080d14-51e8-4e43-8afd-2714a82145b1', '3fe9bcdc-ffa2-488a-97f3-931196873415', '400be72f-4175-4c89-93a5-9ca1db9a69f7', '7c841b29-c982-447d-9942-856ca0a0fd81'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:17:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:17:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:17:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:39 devstack sudo[103221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:17:39 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:39 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.643s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:39 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:17:39 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Deleted volume successfully.
Jul 09 09:17:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e37ee002-7034-42ff-9943-48a4a96dced7 tempest-VolumesCloneNegativeTest-715434734 None] Lock "cinder-227f0705-26d8-4517-83bc-990f3d70ac96-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Acquiring lock "cinder-c6b77de8-7bfc-433f-9713-dc2fe84d5a43-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Lock "cinder-c6b77de8-7bfc-433f-9713-dc2fe84d5a43-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Acquiring lock "cinder-quobyte-c6b77de8-7bfc-433f-9713-dc2fe84d5a43" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Lock "cinder-quobyte-c6b77de8-7bfc-433f-9713-dc2fe84d5a43" acquired by "delete_volume" :: waited 0.031s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:40 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c1d2d1-140e-4f23-a4ac-c871c0f170d0]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:40 devstack sudo[103224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43
Jul 09 09:17:40 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:40 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43" returned: 0 in 0.774s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:40 devstack sudo[103229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43
Jul 09 09:17:40 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:41 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-c6b77de8-7bfc-433f-9713-dc2fe84d5a43" returned: 0 in 0.684s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Lock "cinder-quobyte-c6b77de8-7bfc-433f-9713-dc2fe84d5a43" released by "delete_volume" :: held 1.521s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:41 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Created reservations ['e59474e6-e84e-4b17-9e64-cae424066b42', '490cc223-9efc-475d-97a0-6694b46a5420', 'ceacc628-c407-4603-bc8c-9610078e56bd', 'eb433f43-5050-475f-ac1c-690499a46fec'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:17:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:17:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:17:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:41 devstack sudo[103232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:17:41 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Acquiring lock "cinder-a9cff932-b7c6-4d1f-9887-52ee766829b2-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Lock "cinder-a9cff932-b7c6-4d1f-9887-52ee766829b2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Acquiring lock "cinder-quobyte-a9cff932-b7c6-4d1f-9887-52ee766829b2" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Lock "cinder-quobyte-a9cff932-b7c6-4d1f-9887-52ee766829b2" acquired by "delete_volume" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[36453a83-4a4f-4fd2-a57a-1614aa8a1a72]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a9cff932-b7c6-4d1f-9887-52ee766829b2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:42 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.700s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:17:42 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Deleted volume successfully.
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e89c5d-8a79-430e-b475-5c52ed113a49 tempest-CinderUnicodeTest-1254913375 None] Lock "cinder-c6b77de8-7bfc-433f-9713-dc2fe84d5a43-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:42 devstack sudo[103235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a9cff932-b7c6-4d1f-9887-52ee766829b2
Jul 09 09:17:42 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Flow 'volume_create_manager' (f957e766-8425-4918-ab82-63143df1044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec2f067-b36c-457a-bc55-622f19a8cd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec2f067-b36c-457a-bc55-622f19a8cd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-568049242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ce9d9b-d16d-401c-9fd7-897c87313bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0440967e5838429bbdc1a46f377f69f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:17:43Z,use_quota=True,user_id='c56850bca80a4693b41be7baff96b97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f14ff3-6340-47a2-b107-da29cd1cc6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f14ff3-6340-47a2-b107-da29cd1cc6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2821ba-c6b9-4279-811e-a0f8db25da6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2821ba-c6b9-4279-811e-a0f8db25da6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ce9d9b-d16d-401c-9fd7-897c87313bef', 'volume_name': 'volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cdf7f8-2cc6-4981-bedb-4312b7510f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cdf7f8-2cc6-4981-bedb-4312b7510f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6eb10d1-fe85-4e2f-be60-58f79fd1d2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:42 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Volume b4ce9d9b-d16d-401c-9fd7-897c87313bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef', 'volume_size': 1}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-568049242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ce9d9b-d16d-401c-9fd7-897c87313bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0440967e5838429bbdc1a46f377f69f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:17:43Z,use_quota=True,user_id='c56850bca80a4693b41be7baff96b97e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Creating volume b4ce9d9b-d16d-401c-9fd7-897c87313bef {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:17:42 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:17:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:42 devstack sudo[103237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef 1073741824
Jul 09 09:17:42 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:43 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a9cff932-b7c6-4d1f-9887-52ee766829b2" returned: 0 in 0.818s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a9cff932-b7c6-4d1f-9887-52ee766829b2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:43 devstack sudo[103242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a9cff932-b7c6-4d1f-9887-52ee766829b2
Jul 09 09:17:43 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:43 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef 1073741824" returned: 0 in 0.833s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:43 devstack sudo[103247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef
Jul 09 09:17:43 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:43 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a9cff932-b7c6-4d1f-9887-52ee766829b2" returned: 0 in 0.693s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Lock "cinder-quobyte-a9cff932-b7c6-4d1f-9887-52ee766829b2" released by "delete_volume" :: held 1.566s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:43 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Created reservations ['b593e65e-1bed-4091-9b66-22589807fa77', '22a8886c-bd64-4893-ba9f-447c41fc652c', 'f91a4f0d-82c6-4406-a3eb-2f817151ae04', 'bb17c5f4-5a98-45a1-b8ed-d75db9d6255e'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:44 devstack sudo[103250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:17:44 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:44 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef" returned: 0 in 0.671s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6eb10d1-fe85-4e2f-be60-58f79fd1d2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e035ce-86d4-4177-9d81-89f091cd985c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:17:44 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Volume volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef (b4ce9d9b-d16d-401c-9fd7-897c87313bef): created successfully
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e035ce-86d4-4177-9d81-89f091cd985c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Flow 'volume_create_manager' (f957e766-8425-4918-ab82-63143df1044b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:17:44 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7431dd0c-8c02-4565-bfa1-2141bd219fd3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Created volume successfully.
Jul 09 09:17:44 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.678s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:17:44 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Deleted volume successfully.
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-64cf8148-10f7-4c68-bc54-cedccb57e5fc tempest-CinderUnicodeTest-1254913375 None] Lock "cinder-a9cff932-b7c6-4d1f-9887-52ee766829b2-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] Creating offline snapshot 51d4c063-64d2-4a9e-bc50-4c3c60c1508a of volume b4ce9d9b-d16d-401c-9fd7-897c87313bef {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[266b414b-ecc4-49c6-9bda-10421c055078]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:45 devstack sudo[103254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef
Jul 09 09:17:45 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:45 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef" returned: 0 in 0.850s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:45 devstack sudo[103260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a 1G
Jul 09 09:17:45 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:46 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a 1G" returned: 0 in 0.820s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:46 devstack sudo[103265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a
Jul 09 09:17:46 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:47 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a" returned: 0 in 0.726s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:47 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a is being set with open permissions: ugo+rw
Jul 09 09:17:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:47 devstack sudo[103270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a
Jul 09 09:17:47 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a" returned: 0 in 0.645s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:48 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:48 devstack sudo[103273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.info
Jul 09 09:17:48 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:48 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.info" returned: 0 in 0.703s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:48 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.info is being set with open permissions: ugo+rw
Jul 09 09:17:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:48 devstack sudo[103276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.info
Jul 09 09:17:48 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:49 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.info" returned: 0 in 0.662s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.499s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:49 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e8f3d716-84aa-4a29-b133-5e7f82d0407d tempest-VolumesSnapshotListTestJSON-1737539843 None] Create snapshot completed successfully
Jul 09 09:17:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] Creating offline snapshot 18464fbf-b3ff-4ff2-87de-e15a02fddfeb of volume b4ce9d9b-d16d-401c-9fd7-897c87313bef {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:17:50 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6bba7b-7373-4ebf-87e3-e048dd1068b3]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:50 devstack sudo[103280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a
Jul 09 09:17:50 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:51 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a" returned: 0 in 0.783s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:17:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:51 devstack sudo[103285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb 1G
Jul 09 09:17:51 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:52 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb 1G" returned: 0 in 0.901s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:52 devstack sudo[103291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb
Jul 09 09:17:52 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:52 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb" returned: 0 in 0.741s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:52 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb is being set with open permissions: ugo+rw
Jul 09 09:17:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:52 devstack sudo[103297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb
Jul 09 09:17:52 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:53 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb" returned: 0 in 0.662s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.211s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:53 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-1901a822-d6d1-44b0-9016-63cd909c77fd tempest-VolumesSnapshotListTestJSON-1737539843 None] Create snapshot completed successfully
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:54 devstack sudo[103300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:17:54 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Creating offline snapshot ac57c49f-afab-46ba-8701-8ef271332df8 of volume b4ce9d9b-d16d-401c-9fd7-897c87313bef {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48b969d-5d4a-4c11-9d57-60c20b0d767d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:54 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.672s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:17:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:17:54 devstack sudo[103303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb
Jul 09 09:17:54 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:55 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb" returned: 0 in 0.747s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:17:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:55 devstack sudo[103308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8 1G
Jul 09 09:17:55 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:56 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8 1G" returned: 0 in 0.820s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:56 devstack sudo[103313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8
Jul 09 09:17:56 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:56 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8" returned: 0 in 0.663s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:57 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8 is being set with open permissions: ugo+rw
Jul 09 09:17:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:57 devstack sudo[103318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8
Jul 09 09:17:57 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:57 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8" returned: 0 in 0.638s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.960s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:17:57 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-df319bfd-58bb-495f-bacd-4610dd64c7d3 tempest-VolumesSnapshotListTestJSON-1737539843 None] Create snapshot completed successfully
Jul 09 09:17:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "cinder-ac57c49f-afab-46ba-8701-8ef271332df8-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-ac57c49f-afab-46ba-8701-8ef271332df8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "cinder-quobyte-b4ce9d9b-d16d-401c-9fd7-897c87313bef" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-quobyte-b4ce9d9b-d16d-401c-9fd7-897c87313bef" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "cinder-quobyte-ac57c49f-afab-46ba-8701-8ef271332df8" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:17:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-quobyte-ac57c49f-afab-46ba-8701-8ef271332df8" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:17:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Deleting offline snapshot ac57c49f-afab-46ba-8701-8ef271332df8 of volume b4ce9d9b-d16d-401c-9fd7-897c87313bef {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:17:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] snapshot_file for this snap is: volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:17:58 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d39ce8-9c5a-4e40-9cd9-5562257b8d15]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:58 devstack sudo[103321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8
Jul 09 09:17:58 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:17:59 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root
Jul 09 09:17:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8" returned: 0 in 0.750s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:17:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:17:59 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3d884b-428b-4331-b5e8-a6384fcc7c6f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:17:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:17:59 devstack sudo[103327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb
Jul 09 09:17:59 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:00 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb" returned: 0 in 0.741s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:18:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:00 devstack sudo[103332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8
Jul 09 09:18:00 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:00 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8" returned: 0 in 0.783s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:01 devstack sudo[103337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8
Jul 09 09:18:01 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:01 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.ac57c49f-afab-46ba-8701-8ef271332df8" returned: 0 in 0.644s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-quobyte-ac57c49f-afab-46ba-8701-8ef271332df8" released by "_delete_snapshot" :: held 3.026s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-quobyte-b4ce9d9b-d16d-401c-9fd7-897c87313bef" released by "delete_snapshot" :: held 3.096s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:01 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Created reservations ['154c2b94-1fc6-4827-a54f-b72cc2471814', 'a01bb80d-a90f-45de-93a9-fac99e286e73', '97a8041d-b1ad-4ffd-ad53-09c741c00937', 'e2a5c363-e40e-4565-b719-acf2067d26d3'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:18:01 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Delete snapshot completed successfully.
Jul 09 09:18:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b63bc745-18b0-45a7-9f49-09f0f9819309 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-ac57c49f-afab-46ba-8701-8ef271332df8-delete_snapshot" released by "delete_snapshot" :: held 3.229s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "cinder-18464fbf-b3ff-4ff2-87de-e15a02fddfeb-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:18:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-18464fbf-b3ff-4ff2-87de-e15a02fddfeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:18:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "cinder-quobyte-b4ce9d9b-d16d-401c-9fd7-897c87313bef" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:18:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-quobyte-b4ce9d9b-d16d-401c-9fd7-897c87313bef" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:18:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "cinder-quobyte-18464fbf-b3ff-4ff2-87de-e15a02fddfeb" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:18:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-quobyte-18464fbf-b3ff-4ff2-87de-e15a02fddfeb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:18:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Deleting offline snapshot 18464fbf-b3ff-4ff2-87de-e15a02fddfeb of volume b4ce9d9b-d16d-401c-9fd7-897c87313bef {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:18:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] snapshot_file for this snap is: volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:18:02 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3381f3-0aed-4f6e-9263-07780386b4cc]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:18:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:02 devstack sudo[103341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb
Jul 09 09:18:02 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:03 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb" returned: 0 in 0.752s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:03 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:18:03 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6c50c0-a95b-45e1-b285-a0f323cc0156]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:18:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:03 devstack sudo[103346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a
Jul 09 09:18:03 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:04 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a" returned: 0 in 0.786s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:18:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:04 devstack sudo[103351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb
Jul 09 09:18:04 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:05 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb" returned: 0 in 0.717s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:05 devstack sudo[103356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb
Jul 09 09:18:05 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:05 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.18464fbf-b3ff-4ff2-87de-e15a02fddfeb" returned: 0 in 0.623s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-quobyte-18464fbf-b3ff-4ff2-87de-e15a02fddfeb" released by "_delete_snapshot" :: held 2.972s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-quobyte-b4ce9d9b-d16d-401c-9fd7-897c87313bef" released by "delete_snapshot" :: held 2.995s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:05 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Created reservations ['15626956-2d58-4a33-b9ce-5466f0b0eff8', '2e0dcbf6-ec10-4d67-b3a1-c56a4e3608d1', '9562b14c-e4e9-4e70-9a05-672f24a7d6d4', '6d825baa-9ff3-46f4-976e-96ab81ad81d4'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:18:05 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Delete snapshot completed successfully.
Jul 09 09:18:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-dffe731f-3f49-4e2b-b5d5-da57ea1e04d8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-18464fbf-b3ff-4ff2-87de-e15a02fddfeb-delete_snapshot" released by "delete_snapshot" :: held 3.126s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "cinder-51d4c063-64d2-4a9e-bc50-4c3c60c1508a-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:18:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-51d4c063-64d2-4a9e-bc50-4c3c60c1508a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:18:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "cinder-quobyte-b4ce9d9b-d16d-401c-9fd7-897c87313bef" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:18:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-quobyte-b4ce9d9b-d16d-401c-9fd7-897c87313bef" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:18:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "cinder-quobyte-51d4c063-64d2-4a9e-bc50-4c3c60c1508a" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:18:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-quobyte-51d4c063-64d2-4a9e-bc50-4c3c60c1508a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:18:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Deleting offline snapshot 51d4c063-64d2-4a9e-bc50-4c3c60c1508a of volume b4ce9d9b-d16d-401c-9fd7-897c87313bef {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:18:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] snapshot_file for this snap is: volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:18:07 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fa7655-13e3-4611-883d-493b0f3e0508]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:18:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:07 devstack sudo[103359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a
Jul 09 09:18:07 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:07 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a" returned: 0 in 0.770s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:18:07 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7277e602-21f6-4dda-9d26-219cd23aeffe]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:18:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:07 devstack sudo[103364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef
Jul 09 09:18:07 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:08 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef" returned: 0 in 0.757s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:08 devstack sudo[103369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a
Jul 09 09:18:08 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:09 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a" returned: 0 in 0.730s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:09 devstack sudo[103375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a
Jul 09 09:18:09 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:09 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef.51d4c063-64d2-4a9e-bc50-4c3c60c1508a" returned: 0 in 0.626s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-quobyte-51d4c063-64d2-4a9e-bc50-4c3c60c1508a" released by "_delete_snapshot" :: held 2.982s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-quobyte-b4ce9d9b-d16d-401c-9fd7-897c87313bef" released by "delete_snapshot" :: held 3.004s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:10 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Created reservations ['4fd5381a-880a-4874-b244-a13dd5b602d4', 'ca18a351-e9c3-4229-8b6d-99c4dfee5551', '95ffab86-87fd-486c-9916-1ec51da15a9d', '6005e0c1-cf57-43ff-bf99-737e4293aa9a'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:18:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Delete snapshot completed successfully.
Jul 09 09:18:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-49dfe542-f59c-40ef-950b-6b6102360bf8 tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-51d4c063-64d2-4a9e-bc50-4c3c60c1508a-delete_snapshot" released by "delete_snapshot" :: held 3.148s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "cinder-b4ce9d9b-d16d-401c-9fd7-897c87313bef-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:18:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-b4ce9d9b-d16d-401c-9fd7-897c87313bef-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:18:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "cinder-quobyte-b4ce9d9b-d16d-401c-9fd7-897c87313bef" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:18:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-quobyte-b4ce9d9b-d16d-401c-9fd7-897c87313bef" acquired by "delete_volume" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:18:11 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd700958-ac36-4e0b-829d-5d8102d5de1f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:18:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:11 devstack sudo[103378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef
Jul 09 09:18:11 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:12 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef" returned: 0 in 0.739s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:12 devstack sudo[103383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef
Jul 09 09:18:12 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:12 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b4ce9d9b-d16d-401c-9fd7-897c87313bef" returned: 0 in 0.629s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-quobyte-b4ce9d9b-d16d-401c-9fd7-897c87313bef" released by "delete_volume" :: held 1.422s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:12 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Created reservations ['6c594842-da65-4dad-8a84-1680debf36b7', 'c51bc69c-e7c0-43a0-a194-9712d7f8f0e9', '10aa17a2-caf7-44f4-b96c-baf0e0a623b5', 'c3d65682-b5bf-4534-9df6-cbc11cc69fd9'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:18:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:18:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:18:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:18:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:18:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:18:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:12 devstack sudo[103386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:18:12 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:13 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.636s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:13 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:18:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Deleted volume successfully.
Jul 09 09:18:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bfc2206d-2847-4fe8-a785-6ed7af949d2b tempest-VolumesSnapshotListTestJSON-1737539843 None] Lock "cinder-b4ce9d9b-d16d-401c-9fd7-897c87313bef-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Flow 'volume_create_manager' (b11f10b1-ec6d-466b-8d93-87fb18e5b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5715dc4-15d9-424d-80df-cbceee47a3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5715dc4-15d9-424d-80df-cbceee47a3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-115468753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b713ca8f-15e2-4582-b191-6dc44327ec44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb0c8733950416faf9ff8d4cb98c30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:18:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:18:16Z,use_quota=True,user_id='cabe58b55f024116b6c6e0b7c7ffdbc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7a8ac2-c185-48a1-99db-a4cd18e9193a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7a8ac2-c185-48a1-99db-a4cd18e9193a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe729e5-164f-4778-b869-13abc17d4349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe729e5-164f-4778-b869-13abc17d4349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b713ca8f-15e2-4582-b191-6dc44327ec44', 'volume_name': 'volume-b713ca8f-15e2-4582-b191-6dc44327ec44', 'volume_size': 2}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e478267f-01dc-4068-a843-e5af6f243146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e478267f-01dc-4068-a843-e5af6f243146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcc0364-2c66-4392-b317-05c2dd15f9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:16 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Volume b713ca8f-15e2-4582-b191-6dc44327ec44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b713ca8f-15e2-4582-b191-6dc44327ec44', 'volume_size': 2}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-115468753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b713ca8f-15e2-4582-b191-6dc44327ec44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb0c8733950416faf9ff8d4cb98c30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:18:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:18:16Z,use_quota=True,user_id='cabe58b55f024116b6c6e0b7c7ffdbc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Creating volume b713ca8f-15e2-4582-b191-6dc44327ec44 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:18:16 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:18:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44 2147483648 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:16 devstack sudo[103389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44 2147483648
Jul 09 09:18:16 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:17 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44 2147483648" returned: 0 in 0.843s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:17 devstack sudo[103394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44
Jul 09 09:18:17 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:17 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44" returned: 0 in 0.638s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:18:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:18:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcc0364-2c66-4392-b317-05c2dd15f9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b713ca8f-15e2-4582-b191-6dc44327ec44', 'volume_size': 2}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb636c4a-7f12-478b-bb0d-5e0d1eb2ab33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:17 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Volume volume-b713ca8f-15e2-4582-b191-6dc44327ec44 (b713ca8f-15e2-4582-b191-6dc44327ec44): created successfully
Jul 09 09:18:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb636c4a-7f12-478b-bb0d-5e0d1eb2ab33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Flow 'volume_create_manager' (b11f10b1-ec6d-466b-8d93-87fb18e5b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:18:17 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-06e5d7e1-00ae-47a6-b30a-02b456a66cb1 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Created volume successfully.
Jul 09 09:18:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:18:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:18:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Creating offline snapshot 7167916e-65ce-42c9-9429-30cd0ad26f3a of volume b713ca8f-15e2-4582-b191-6dc44327ec44 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:18:18 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[812c707d-15c3-443b-b639-dc015258215d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:18:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:18 devstack sudo[103397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44
Jul 09 09:18:18 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:19 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44" returned: 0 in 0.742s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a 2G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:19 devstack sudo[103403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a 2G
Jul 09 09:18:19 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:19 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a 2G" returned: 0 in 0.764s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b713ca8f-15e2-4582-b191-6dc44327ec44 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:20 devstack sudo[103411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b713ca8f-15e2-4582-b191-6dc44327ec44 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a
Jul 09 09:18:20 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:20 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b713ca8f-15e2-4582-b191-6dc44327ec44 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a" returned: 0 in 0.675s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:20 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a is being set with open permissions: ugo+rw
Jul 09 09:18:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:20 devstack sudo[103416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a
Jul 09 09:18:20 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:21 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a" returned: 0 in 0.623s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:21 devstack sudo[103419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.info
Jul 09 09:18:21 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:21 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.info" returned: 0 in 0.654s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:21 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.info is being set with open permissions: ugo+rw
Jul 09 09:18:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:21 devstack sudo[103422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.info
Jul 09 09:18:21 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:22 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.info" returned: 0 in 0.638s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.179s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:18:22 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e75192ce-8f7d-49da-b332-ca1c3d94182d tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Create snapshot completed successfully
Jul 09 09:18:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Acquiring lock "cinder-7167916e-65ce-42c9-9429-30cd0ad26f3a-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:18:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "cinder-7167916e-65ce-42c9-9429-30cd0ad26f3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:18:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Acquiring lock "cinder-quobyte-b713ca8f-15e2-4582-b191-6dc44327ec44" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:18:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "cinder-quobyte-b713ca8f-15e2-4582-b191-6dc44327ec44" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:18:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Acquiring lock "cinder-quobyte-7167916e-65ce-42c9-9429-30cd0ad26f3a" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:18:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "cinder-quobyte-7167916e-65ce-42c9-9429-30cd0ad26f3a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:18:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Deleting offline snapshot 7167916e-65ce-42c9-9429-30cd0ad26f3a of volume b713ca8f-15e2-4582-b191-6dc44327ec44 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:18:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] snapshot_file for this snap is: volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:18:23 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9862012c-b7e4-41be-9b3f-34ca8313f996]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:18:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:23 devstack sudo[103427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a
Jul 09 09:18:23 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:24 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a" returned: 0 in 0.748s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b713ca8f-15e2-4582-b191-6dc44327ec44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:18:24 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d271d9-e7c2-455e-a026-9309967f69e9]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:18:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:24 devstack sudo[103432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44
Jul 09 09:18:24 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:25 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44" returned: 0 in 0.771s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:25 devstack sudo[103473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a
Jul 09 09:18:25 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:26 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a" returned: 0 in 0.702s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:26 devstack sudo[103478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a
Jul 09 09:18:26 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:26 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44.7167916e-65ce-42c9-9429-30cd0ad26f3a" returned: 0 in 0.634s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:26 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=101,cinder:SELECT=75,cinder:DELETE=9,cinder:INSERT=21 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:18:26 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=88,cinder:SELECT=79,cinder:INSERT=28,cinder:DELETE=8 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:18:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "cinder-quobyte-7167916e-65ce-42c9-9429-30cd0ad26f3a" released by "_delete_snapshot" :: held 2.960s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "cinder-quobyte-b713ca8f-15e2-4582-b191-6dc44327ec44" released by "delete_snapshot" :: held 2.987s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:26 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Created reservations ['f6f00e34-c37c-4462-afdb-ef660a15b2b2', '3af597b7-3af8-4c52-a9df-48887bf3ef47', '2ce210d3-85f8-48a6-923d-f03453d4dc8d', '84561b30-839f-4445-896c-251f62cb04b7'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:18:26 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Delete snapshot completed successfully.
Jul 09 09:18:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-1ea77742-6302-45d2-a989-652d392187fd tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "cinder-7167916e-65ce-42c9-9429-30cd0ad26f3a-delete_snapshot" released by "delete_snapshot" :: held 3.115s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Acquiring lock "cinder-b713ca8f-15e2-4582-b191-6dc44327ec44-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:18:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "cinder-b713ca8f-15e2-4582-b191-6dc44327ec44-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:18:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Acquiring lock "cinder-quobyte-b713ca8f-15e2-4582-b191-6dc44327ec44" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:18:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "cinder-quobyte-b713ca8f-15e2-4582-b191-6dc44327ec44" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:18:27 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a64ce3-4348-4b84-ab57-badc599bf14f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:18:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:27 devstack sudo[103481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44
Jul 09 09:18:27 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:27 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44" returned: 0 in 0.736s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:27 devstack sudo[103486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44
Jul 09 09:18:27 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:28 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-b713ca8f-15e2-4582-b191-6dc44327ec44" returned: 0 in 0.646s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "cinder-quobyte-b713ca8f-15e2-4582-b191-6dc44327ec44" released by "delete_volume" :: held 1.435s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:28 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Created reservations ['c39cfd66-e9f9-4913-8742-d19d4012b79b', '7c5aeefa-3dfb-4fa3-9af6-dfce5c3a433b', 'b83a3eec-8779-47b7-9d16-7d7989678cd5', 'f14fc731-02cf-4304-baee-2325a27296a3'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:18:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:18:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:18:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:18:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:18:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:18:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:28 devstack sudo[103489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:18:28 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:29 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.631s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:29 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:18:29 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Deleted volume successfully.
Jul 09 09:18:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fabf99e8-9bc3-4551-878b-a16c5ad48e00 tempest-VolumesSnapshotNegativeTestJSON-1506343881 None] Lock "cinder-b713ca8f-15e2-4582-b191-6dc44327ec44-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:18:38 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=12 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:18:39 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Flow 'volume_create_manager' (5492ce43-d779-47e1-9cbc-007a71585b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0f75f3-50c3-465a-a238-a438ba864965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0f75f3-50c3-465a-a238-a438ba864965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-640680465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57367d1a-a4b0-468a-8ea4-eea2e4223573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae4d208439f4e9dbc27630d7f04d62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:18:47Z,use_quota=True,user_id='f30d83237dca4ef59372f0bf1409e2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8182b5e0-add8-4d44-a360-878ee26aa973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8182b5e0-add8-4d44-a360-878ee26aa973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bb1c59-5734-4573-b1ce-08550f381061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bb1c59-5734-4573-b1ce-08550f381061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57367d1a-a4b0-468a-8ea4-eea2e4223573', 'volume_name': 'volume-57367d1a-a4b0-468a-8ea4-eea2e4223573', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2a8f0c-9e89-431a-a291-d5bf519fe3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2a8f0c-9e89-431a-a291-d5bf519fe3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74be11e9-e7bf-4954-b4c3-d92f614a33e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:46 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Volume 57367d1a-a4b0-468a-8ea4-eea2e4223573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57367d1a-a4b0-468a-8ea4-eea2e4223573', 'volume_size': 1}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-640680465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57367d1a-a4b0-468a-8ea4-eea2e4223573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae4d208439f4e9dbc27630d7f04d62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:18:47Z,use_quota=True,user_id='f30d83237dca4ef59372f0bf1409e2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Creating volume 57367d1a-a4b0-468a-8ea4-eea2e4223573 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:18:46 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:18:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:46 devstack sudo[103502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573 1073741824
Jul 09 09:18:46 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:47 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:18:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Flow 'volume_create_manager' (5c1b787a-61f4-4b9a-9854-4c3f5f7619bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:18:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9a76ec-1687-4e7a-8454-8a8bf182a13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9a76ec-1687-4e7a-8454-8a8bf182a13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1346438971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b61902-344b-441f-817f-789839a770d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae4d208439f4e9dbc27630d7f04d62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:18:47Z,use_quota=True,user_id='f30d83237dca4ef59372f0bf1409e2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df314c7-74e5-468d-a6e4-aca0f4919b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df314c7-74e5-468d-a6e4-aca0f4919b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4a5e68-5cef-4fb7-a770-54cded1141df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4a5e68-5cef-4fb7-a770-54cded1141df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b61902-344b-441f-817f-789839a770d9', 'volume_name': 'volume-18b61902-344b-441f-817f-789839a770d9', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0023ff8d-49d7-42d4-beae-744b1629244e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0023ff8d-49d7-42d4-beae-744b1629244e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0851af9-fe7f-4eb9-8a36-c2e228e74819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:47 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Volume 18b61902-344b-441f-817f-789839a770d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b61902-344b-441f-817f-789839a770d9', 'volume_size': 1}
Jul 09 09:18:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:18:47 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573 1073741824" returned: 0 in 0.882s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:47 devstack sudo[103507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573
Jul 09 09:18:47 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:48 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573" returned: 0 in 0.690s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.279s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1346438971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b61902-344b-441f-817f-789839a770d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae4d208439f4e9dbc27630d7f04d62f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:18:47Z,use_quota=True,user_id='f30d83237dca4ef59372f0bf1409e2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Creating volume 18b61902-344b-441f-817f-789839a770d9 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:18:48 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74be11e9-e7bf-4954-b4c3-d92f614a33e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57367d1a-a4b0-468a-8ea4-eea2e4223573', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:48 devstack sudo[103510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9 1073741824
Jul 09 09:18:48 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e038f51-8254-47c8-b706-3b4a92b86df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:48 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Volume volume-57367d1a-a4b0-468a-8ea4-eea2e4223573 (57367d1a-a4b0-468a-8ea4-eea2e4223573): created successfully
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e038f51-8254-47c8-b706-3b4a92b86df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Flow 'volume_create_manager' (5492ce43-d779-47e1-9cbc-007a71585b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:18:48 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e6cd7094-26a6-4730-a24c-290e5f8b6d0b tempest-TestServerVolumeAttachmentScenario-704098731 None] Created volume successfully.
Jul 09 09:18:49 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9 1073741824" returned: 0 in 0.898s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:49 devstack sudo[103517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9
Jul 09 09:18:49 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:50 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9" returned: 0 in 0.646s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:18:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:18:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0851af9-fe7f-4eb9-8a36-c2e228e74819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b61902-344b-441f-817f-789839a770d9', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267123f1-8dee-4c0c-bf3c-d31df2625a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:18:50 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Volume volume-18b61902-344b-441f-817f-789839a770d9 (18b61902-344b-441f-817f-789839a770d9): created successfully
Jul 09 09:18:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267123f1-8dee-4c0c-bf3c-d31df2625a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:18:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Flow 'volume_create_manager' (5c1b787a-61f4-4b9a-9854-4c3f5f7619bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:18:50 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-0ee49eed-6ec3-47bf-a3dd-b1909d45092b tempest-TestServerVolumeAttachmentScenario-704098731 None] Created volume successfully.
Jul 09 09:18:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:18:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:18:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:18:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:18:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:18:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:18:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:18:54 devstack sudo[103523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:18:54 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:18:54 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root
Jul 09 09:18:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.630s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:18:54 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:18:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:18:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:18:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:19:00 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:19:00 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:19:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-991c158c-d5f8-40e2-aee8-810901764af0 req-372dd125-814b-45a5-be26-1f48d31a5e01 tempest-TestServerVolumeAttachmentScenario-704098731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:19:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-991c158c-d5f8-40e2-aee8-810901764af0 req-372dd125-814b-45a5-be26-1f48d31a5e01 tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:19:29 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49d2570-e602-44ec-86da-fb619ad66f92]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:19:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-991c158c-d5f8-40e2-aee8-810901764af0 req-372dd125-814b-45a5-be26-1f48d31a5e01 tempest-TestServerVolumeAttachmentScenario-704098731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:19:29 devstack sudo[103691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573
Jul 09 09:19:29 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:19:30 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root
Jul 09 09:19:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-991c158c-d5f8-40e2-aee8-810901764af0 req-372dd125-814b-45a5-be26-1f48d31a5e01 tempest-TestServerVolumeAttachmentScenario-704098731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573" returned: 0 in 0.739s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:19:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-991c158c-d5f8-40e2-aee8-810901764af0 req-372dd125-814b-45a5-be26-1f48d31a5e01 tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.755s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:19:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-991c158c-d5f8-40e2-aee8-810901764af0 req-372dd125-814b-45a5-be26-1f48d31a5e01 tempest-TestServerVolumeAttachmentScenario-704098731 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-57367d1a-a4b0-468a-8ea4-eea2e4223573', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a81a4191-45bc-4d72-a1ff-1dd1445bef74', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:19:30 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-991c158c-d5f8-40e2-aee8-810901764af0 req-372dd125-814b-45a5-be26-1f48d31a5e01 tempest-TestServerVolumeAttachmentScenario-704098731 None] attachment_update completed successfully.
Jul 09 09:19:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-8bcbaf28-2b8a-4db3-8cbb-ff1fe5a69abb req-db5bb3f5-90c3-4c7e-963d-6397323e2ad5 tempest-TestServerVolumeAttachmentScenario-704098731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:19:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-8bcbaf28-2b8a-4db3-8cbb-ff1fe5a69abb req-db5bb3f5-90c3-4c7e-963d-6397323e2ad5 tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:19:38 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0de4e6d-bca1-4adf-ae36-c82522fffdda]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:19:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-8bcbaf28-2b8a-4db3-8cbb-ff1fe5a69abb req-db5bb3f5-90c3-4c7e-963d-6397323e2ad5 tempest-TestServerVolumeAttachmentScenario-704098731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:19:39 devstack sudo[104095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9
Jul 09 09:19:39 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:19:39 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root
Jul 09 09:19:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [req-8bcbaf28-2b8a-4db3-8cbb-ff1fe5a69abb req-db5bb3f5-90c3-4c7e-963d-6397323e2ad5 tempest-TestServerVolumeAttachmentScenario-704098731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9" returned: 0 in 0.780s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:19:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [req-8bcbaf28-2b8a-4db3-8cbb-ff1fe5a69abb req-db5bb3f5-90c3-4c7e-963d-6397323e2ad5 tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.797s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:19:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-8bcbaf28-2b8a-4db3-8cbb-ff1fe5a69abb req-db5bb3f5-90c3-4c7e-963d-6397323e2ad5 tempest-TestServerVolumeAttachmentScenario-704098731 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d', 'name': 'volume-18b61902-344b-441f-817f-789839a770d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '152bb4ea-9b90-4631-9cce-a557dab0a583', 'enforce_multipath': True} {{(pid=87009) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 09 09:19:39 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-8bcbaf28-2b8a-4db3-8cbb-ff1fe5a69abb req-db5bb3f5-90c3-4c7e-963d-6397323e2ad5 tempest-TestServerVolumeAttachmentScenario-704098731 None] attachment_update completed successfully.
Jul 09 09:19:45 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-89998d06-3f3d-4d6d-a103-6b7530321612 req-1d40f233-f4fe-4f3c-aec7-51b130ab4b72 tempest-TestServerVolumeAttachmentScenario-704098731 None] Terminate volume connection completed successfully.
Jul 09 09:19:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-89998d06-3f3d-4d6d-a103-6b7530321612 req-1d40f233-f4fe-4f3c-aec7-51b130ab4b72 tempest-TestServerVolumeAttachmentScenario-704098731 None] Deleting attachment 152bb4ea-9b90-4631-9cce-a557dab0a583. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:19:49 devstack cinder-volume[87009]: INFO cinder.volume.manager [req-1d6a0a6c-d145-4a8e-a21e-c47af2f23c65 req-cfb53554-73dd-4c46-802a-41f280bc0226 tempest-TestServerVolumeAttachmentScenario-704098731 None] Terminate volume connection completed successfully.
Jul 09 09:19:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [req-1d6a0a6c-d145-4a8e-a21e-c47af2f23c65 req-cfb53554-73dd-4c46-802a-41f280bc0226 tempest-TestServerVolumeAttachmentScenario-704098731 None] Deleting attachment a81a4191-45bc-4d72-a1ff-1dd1445bef74. {{(pid=87009) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 09 09:19:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:19:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:19:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:19:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:19:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:19:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:19:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:19:54 devstack sudo[104160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:19:54 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:19:54 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root
Jul 09 09:19:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.661s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:19:54 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:19:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:19:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:19:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:19:59 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:19:59 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=14,cinder:UPDATE=2 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:19:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Acquiring lock "cinder-18b61902-344b-441f-817f-789839a770d9-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:19:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "cinder-18b61902-344b-441f-817f-789839a770d9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:19:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Acquiring lock "cinder-quobyte-18b61902-344b-441f-817f-789839a770d9" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:19:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "cinder-quobyte-18b61902-344b-441f-817f-789839a770d9" acquired by "delete_volume" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:19:59 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c06bd75-858b-41b2-ae9e-b980465de66c]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:19:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:19:59 devstack sudo[104165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9
Jul 09 09:19:59 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:19:59 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root
Jul 09 09:19:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9" returned: 0 in 0.723s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:19:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:19:59 devstack sudo[104171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9
Jul 09 09:19:59 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:00 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-18b61902-344b-441f-817f-789839a770d9" returned: 0 in 0.648s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "cinder-quobyte-18b61902-344b-441f-817f-789839a770d9" released by "delete_volume" :: held 1.409s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:00 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Created reservations ['e94702af-4923-4185-8f29-809a886d7767', '2beeafb0-210b-4f35-b310-4f7680534f4d', '303cadc7-f564-43d0-b273-67d78085a3c5', '06b9f26d-c2ef-4ffb-88ea-79cd6449ffb5'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:20:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:00 devstack sudo[104174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:20:00 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:01 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Acquiring lock "cinder-57367d1a-a4b0-468a-8ea4-eea2e4223573-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.652s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:01 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:20:01 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Deleted volume successfully.
Jul 09 09:20:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "cinder-57367d1a-a4b0-468a-8ea4-eea2e4223573-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-44842a26-7fa0-46d0-a1e6-8b447bd5889b tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "cinder-18b61902-344b-441f-817f-789839a770d9-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Acquiring lock "cinder-quobyte-57367d1a-a4b0-468a-8ea4-eea2e4223573" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "cinder-quobyte-57367d1a-a4b0-468a-8ea4-eea2e4223573" acquired by "delete_volume" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:01 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[74249d5e-3f19-4960-8cd0-047bd1db5a95]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:20:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:01 devstack sudo[104177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573
Jul 09 09:20:01 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:02 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573" returned: 0 in 0.773s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:02 devstack sudo[104186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573
Jul 09 09:20:02 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:02 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-57367d1a-a4b0-468a-8ea4-eea2e4223573" returned: 0 in 0.650s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "cinder-quobyte-57367d1a-a4b0-468a-8ea4-eea2e4223573" released by "delete_volume" :: held 1.459s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:02 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Created reservations ['80009f3e-f722-4f40-9685-fff3d4de726a', '7126fa38-7b42-47d1-ab24-c3ef3add14a5', '52e07a70-70cb-428e-b1cb-9b39e173e7b7', '756221b5-f0cd-40e6-be9d-64cae7877856'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:20:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:03 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:03 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:03 devstack sudo[104189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:20:03 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:03 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.671s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:03 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:20:03 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Deleted volume successfully.
Jul 09 09:20:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b194deca-2442-402d-b700-8c5c08e9ac4a tempest-TestServerVolumeAttachmentScenario-704098731 None] Lock "cinder-57367d1a-a4b0-468a-8ea4-eea2e4223573-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:12 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:20:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Flow 'volume_create_manager' (dbfe9fe5-2c18-419e-855b-672f921a0693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257a00a9-7b2c-44cd-8cd1-3a163080b169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257a00a9-7b2c-44cd-8cd1-3a163080b169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-859101839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2870bf99-936e-40b5-ba0d-8cfe72e1df67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fd5074a5b84546beed76af4ded3b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:13Z,use_quota=True,user_id='2530b5037d114198bc051c9c8f01f852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e89acf7-2015-498e-9a70-79b14869e143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e89acf7-2015-498e-9a70-79b14869e143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50563bb-fe79-487c-8536-13d4b0b40e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50563bb-fe79-487c-8536-13d4b0b40e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2870bf99-936e-40b5-ba0d-8cfe72e1df67', 'volume_name': 'volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92795d7-1c64-498d-8a0f-715c883f3641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92795d7-1c64-498d-8a0f-715c883f3641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ec6f40-8e97-4689-8949-59e818895ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:13 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume 2870bf99-936e-40b5-ba0d-8cfe72e1df67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67', 'volume_size': 1}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-859101839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2870bf99-936e-40b5-ba0d-8cfe72e1df67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fd5074a5b84546beed76af4ded3b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:13Z,use_quota=True,user_id='2530b5037d114198bc051c9c8f01f852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Creating volume 2870bf99-936e-40b5-ba0d-8cfe72e1df67 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:20:13 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:13 devstack sudo[104197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67 1073741824
Jul 09 09:20:13 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:13 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67 1073741824" returned: 0 in 0.793s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:13 devstack sudo[104202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67
Jul 09 09:20:13 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:14 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67" returned: 0 in 0.623s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:14 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:20:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ec6f40-8e97-4689-8949-59e818895ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82ef3b1-3c35-49c8-a21d-f98e1d1c53bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:14 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67 (2870bf99-936e-40b5-ba0d-8cfe72e1df67): created successfully
Jul 09 09:20:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82ef3b1-3c35-49c8-a21d-f98e1d1c53bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Flow 'volume_create_manager' (dbfe9fe5-2c18-419e-855b-672f921a0693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:14 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-cc5b9a15-baf3-4e5d-a0e3-3b911ae79aa8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Created volume successfully.
Jul 09 09:20:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] Creating offline snapshot b9d27594-5a2a-46db-8011-56f712ac9465 of volume 2870bf99-936e-40b5-ba0d-8cfe72e1df67 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:20:15 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dcc543-9019-4279-8475-af7b5a0c1745]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:20:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:15 devstack sudo[104205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67
Jul 09 09:20:15 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:15 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67" returned: 0 in 0.750s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:16 devstack sudo[104210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465 1G
Jul 09 09:20:16 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:16 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465 1G" returned: 0 in 0.779s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:16 devstack sudo[104215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465
Jul 09 09:20:16 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:17 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465" returned: 0 in 0.672s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:17 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465 is being set with open permissions: ugo+rw
Jul 09 09:20:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:17 devstack sudo[104220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465
Jul 09 09:20:17 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:18 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465" returned: 0 in 0.631s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:18 devstack sudo[104223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.info
Jul 09 09:20:18 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:18 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.info" returned: 0 in 0.637s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:18 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.info is being set with open permissions: ugo+rw
Jul 09 09:20:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:18 devstack sudo[104226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.info
Jul 09 09:20:18 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:19 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.info" returned: 0 in 0.634s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.184s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:19 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-0ab6022f-3dd3-417a-9c55-326c51555432 tempest-CreateVolumesFromSnapshotTest-962168302 None] Create snapshot completed successfully
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Flow 'volume_create_manager' (8049349e-7fbf-49f9-92c0-78c28cf10027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbb5d37-0bcc-437a-b40c-1682de3dc467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efbb5d37-0bcc-437a-b40c-1682de3dc467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1750456207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a252a9d9-148b-4122-b77a-ae6eef73b58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fd5074a5b84546beed76af4ded3b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:21Z,use_quota=True,user_id='2530b5037d114198bc051c9c8f01f852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0df034-b1dc-4ccc-961a-9b8375e44d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd0df034-b1dc-4ccc-961a-9b8375e44d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7579fe53-0683-45e3-945c-f4560f9d427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7579fe53-0683-45e3-945c-f4560f9d427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a252a9d9-148b-4122-b77a-ae6eef73b58d', 'volume_name': 'volume-a252a9d9-148b-4122-b77a-ae6eef73b58d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ded6a09-5aeb-4b73-8896-e6c9d70010cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ded6a09-5aeb-4b73-8896-e6c9d70010cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb245db-143c-4369-99e3-5694fdb8c70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:20 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume a252a9d9-148b-4122-b77a-ae6eef73b58d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a252a9d9-148b-4122-b77a-ae6eef73b58d', 'volume_size': 1}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1750456207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a252a9d9-148b-4122-b77a-ae6eef73b58d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fd5074a5b84546beed76af4ded3b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:21Z,use_quota=True,user_id='2530b5037d114198bc051c9c8f01f852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Creating volume a252a9d9-148b-4122-b77a-ae6eef73b58d {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:20:20 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:20:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a252a9d9-148b-4122-b77a-ae6eef73b58d 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:20 devstack sudo[104231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a252a9d9-148b-4122-b77a-ae6eef73b58d 1073741824
Jul 09 09:20:20 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Flow 'volume_create_manager' (c4689296-5604-494b-abf4-234de60325a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52720dbd-efb9-4511-ad10-7654f103a13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52720dbd-efb9-4511-ad10-7654f103a13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-711830073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765e4e19-db8a-41ad-867e-4a4a3b9f5e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fd5074a5b84546beed76af4ded3b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:21Z,use_quota=True,user_id='2530b5037d114198bc051c9c8f01f852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776aedc9-77fa-4046-b904-d5ad8662ae83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776aedc9-77fa-4046-b904-d5ad8662ae83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3915369f-4e1f-4520-ad2e-99a76e29a295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3915369f-4e1f-4520-ad2e-99a76e29a295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '765e4e19-db8a-41ad-867e-4a4a3b9f5e58', 'volume_name': 'volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e25ee0-4384-409b-aad6-fa1d955e921a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e25ee0-4384-409b-aad6-fa1d955e921a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8f51b9-8556-47b5-84e7-1507feb64777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume 765e4e19-db8a-41ad-867e-4a4a3b9f5e58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58', 'volume_size': 1}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Flow 'volume_create_manager' (10ae3584-e1ec-4cee-80df-b536eea6a399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712b1f95-6d10-46c3-b9a6-d419c397c1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712b1f95-6d10-46c3-b9a6-d419c397c1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1555816548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9890093-2ec0-4b84-bdef-beef575a141d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fd5074a5b84546beed76af4ded3b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:21Z,use_quota=True,user_id='2530b5037d114198bc051c9c8f01f852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ce21b4-7e1b-4ca9-bfdb-165e079bdae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ce21b4-7e1b-4ca9-bfdb-165e079bdae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9251a896-3561-42b3-a6fb-e2c2b7f76067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9251a896-3561-42b3-a6fb-e2c2b7f76067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9890093-2ec0-4b84-bdef-beef575a141d', 'volume_name': 'volume-e9890093-2ec0-4b84-bdef-beef575a141d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaecfc04-76b2-45ce-88c1-2042b61cbc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaecfc04-76b2-45ce-88c1-2042b61cbc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f710bb-8dbb-4789-a663-17d4322fcf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume e9890093-2ec0-4b84-bdef-beef575a141d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9890093-2ec0-4b84-bdef-beef575a141d', 'volume_size': 1}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:21 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a252a9d9-148b-4122-b77a-ae6eef73b58d 1073741824" returned: 0 in 0.929s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a252a9d9-148b-4122-b77a-ae6eef73b58d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:21 devstack sudo[104236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a252a9d9-148b-4122-b77a-ae6eef73b58d
Jul 09 09:20:21 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Flow 'volume_create_manager' (d233b2db-eaac-4377-8672-af48e3f8971e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dca438f-d3d3-45dc-b945-299c19c45297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dca438f-d3d3-45dc-b945-299c19c45297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1458819484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff3429c-99f3-4972-bd28-7cc7a726f32e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fd5074a5b84546beed76af4ded3b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:22Z,use_quota=True,user_id='2530b5037d114198bc051c9c8f01f852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423b28b7-aa74-4cdc-9560-bf1e2c464303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423b28b7-aa74-4cdc-9560-bf1e2c464303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5304bb33-c3f9-44a2-9ba6-0bb587d42116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5304bb33-c3f9-44a2-9ba6-0bb587d42116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff3429c-99f3-4972-bd28-7cc7a726f32e', 'volume_name': 'volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d506df9-ebba-4b64-9aa3-adac64bb3dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d506df9-ebba-4b64-9aa3-adac64bb3dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7c899a-b54b-4c2e-8d35-14a8fcfc717a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:21 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume 8ff3429c-99f3-4972-bd28-7cc7a726f32e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e', 'volume_size': 1}
Jul 09 09:20:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Flow 'volume_create_manager' (4e6b10af-6c3a-4a43-b9b0-d2b7f447a80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63bfa5ad-7b3c-4cbd-8668-db036583380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63bfa5ad-7b3c-4cbd-8668-db036583380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1837431697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687a119d-c9c2-4222-a03f-979530ed5313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fd5074a5b84546beed76af4ded3b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:22Z,use_quota=True,user_id='2530b5037d114198bc051c9c8f01f852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21c12b7-cb26-4e97-a503-0d7f95ead948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21c12b7-cb26-4e97-a503-0d7f95ead948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efde8bce-0c09-4b1f-96a0-6b9cb211a6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efde8bce-0c09-4b1f-96a0-6b9cb211a6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '687a119d-c9c2-4222-a03f-979530ed5313', 'volume_name': 'volume-687a119d-c9c2-4222-a03f-979530ed5313', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f30857-2b73-40f8-a34f-e4c7c1fd3b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f30857-2b73-40f8-a34f-e4c7c1fd3b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530097d0-5bb3-4410-b3cc-6cba71973d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:22 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume 687a119d-c9c2-4222-a03f-979530ed5313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-687a119d-c9c2-4222-a03f-979530ed5313', 'volume_size': 1}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:22 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a252a9d9-148b-4122-b77a-ae6eef73b58d" returned: 0 in 0.669s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.274s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-711830073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765e4e19-db8a-41ad-867e-4a4a3b9f5e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fd5074a5b84546beed76af4ded3b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:21Z,use_quota=True,user_id='2530b5037d114198bc051c9c8f01f852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Creating volume 765e4e19-db8a-41ad-867e-4a4a3b9f5e58 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:20:22 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:22 devstack sudo[104241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58 1073741824
Jul 09 09:20:22 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb245db-143c-4369-99e3-5694fdb8c70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a252a9d9-148b-4122-b77a-ae6eef73b58d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a110551b-51d6-497b-9c98-467eea03e1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:22 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume volume-a252a9d9-148b-4122-b77a-ae6eef73b58d (a252a9d9-148b-4122-b77a-ae6eef73b58d): created successfully
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a110551b-51d6-497b-9c98-467eea03e1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:22 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Flow 'volume_create_manager' (8049349e-7fbf-49f9-92c0-78c28cf10027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:22 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f29ec4e0-3b03-433e-afda-f68473ce8167 tempest-CreateVolumesFromSnapshotTest-962168302 None] Created volume successfully.
Jul 09 09:20:23 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58 1073741824" returned: 0 in 0.825s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:23 devstack sudo[104247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58
Jul 09 09:20:23 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:24 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58" returned: 0 in 0.620s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.421s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1555816548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9890093-2ec0-4b84-bdef-beef575a141d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fd5074a5b84546beed76af4ded3b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:21Z,use_quota=True,user_id='2530b5037d114198bc051c9c8f01f852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Creating volume e9890093-2ec0-4b84-bdef-beef575a141d {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:20:24 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9890093-2ec0-4b84-bdef-beef575a141d 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8f51b9-8556-47b5-84e7-1507feb64777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:24 devstack sudo[104250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9890093-2ec0-4b84-bdef-beef575a141d 1073741824
Jul 09 09:20:24 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5a66b2-5244-4648-9979-71ad41315b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:24 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58 (765e4e19-db8a-41ad-867e-4a4a3b9f5e58): created successfully
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5a66b2-5244-4648-9979-71ad41315b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Flow 'volume_create_manager' (c4689296-5604-494b-abf4-234de60325a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:24 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-fcc320cd-3488-4e0f-b40e-7522b9823702 tempest-CreateVolumesFromSnapshotTest-962168302 None] Created volume successfully.
Jul 09 09:20:24 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9890093-2ec0-4b84-bdef-beef575a141d 1073741824" returned: 0 in 0.809s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9890093-2ec0-4b84-bdef-beef575a141d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:24 devstack sudo[104256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9890093-2ec0-4b84-bdef-beef575a141d
Jul 09 09:20:24 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:25 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9890093-2ec0-4b84-bdef-beef575a141d" returned: 0 in 0.639s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.531s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1458819484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff3429c-99f3-4972-bd28-7cc7a726f32e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fd5074a5b84546beed76af4ded3b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:22Z,use_quota=True,user_id='2530b5037d114198bc051c9c8f01f852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Creating volume 8ff3429c-99f3-4972-bd28-7cc7a726f32e {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:20:25 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:25 devstack sudo[104273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e 1073741824
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f710bb-8dbb-4789-a663-17d4322fcf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9890093-2ec0-4b84-bdef-beef575a141d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:25 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66ee9a5-0bfa-401a-aece-5694caaa1d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:25 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume volume-e9890093-2ec0-4b84-bdef-beef575a141d (e9890093-2ec0-4b84-bdef-beef575a141d): created successfully
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66ee9a5-0bfa-401a-aece-5694caaa1d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Flow 'volume_create_manager' (10ae3584-e1ec-4cee-80df-b536eea6a399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:25 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-445c4d7b-71fa-43f0-9e02-ccfa1b42bf01 tempest-CreateVolumesFromSnapshotTest-962168302 None] Created volume successfully.
Jul 09 09:20:26 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e 1073741824" returned: 0 in 0.833s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:26 devstack sudo[104301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e
Jul 09 09:20:26 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:27 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e" returned: 0 in 0.644s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.723s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1837431697',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687a119d-c9c2-4222-a03f-979530ed5313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fd5074a5b84546beed76af4ded3b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:22Z,use_quota=True,user_id='2530b5037d114198bc051c9c8f01f852',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Creating volume 687a119d-c9c2-4222-a03f-979530ed5313 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:20:27 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-687a119d-c9c2-4222-a03f-979530ed5313 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7c899a-b54b-4c2e-8d35-14a8fcfc717a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:27 devstack sudo[104304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-687a119d-c9c2-4222-a03f-979530ed5313 1073741824
Jul 09 09:20:27 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56555079-4064-41f3-a3b3-1c4a2b2758bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:27 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e (8ff3429c-99f3-4972-bd28-7cc7a726f32e): created successfully
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56555079-4064-41f3-a3b3-1c4a2b2758bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Flow 'volume_create_manager' (d233b2db-eaac-4377-8672-af48e3f8971e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:27 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e4e377bc-3a20-4032-ba62-57c21afe8e92 tempest-CreateVolumesFromSnapshotTest-962168302 None] Created volume successfully.
Jul 09 09:20:27 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-687a119d-c9c2-4222-a03f-979530ed5313 1073741824" returned: 0 in 0.843s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-687a119d-c9c2-4222-a03f-979530ed5313 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:27 devstack sudo[104310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-687a119d-c9c2-4222-a03f-979530ed5313
Jul 09 09:20:27 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:28 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-687a119d-c9c2-4222-a03f-979530ed5313" returned: 0 in 0.626s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:20:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530097d0-5bb3-4410-b3cc-6cba71973d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-687a119d-c9c2-4222-a03f-979530ed5313', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccae84c1-aa6e-4716-80e1-2dacb87fe01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:28 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Volume volume-687a119d-c9c2-4222-a03f-979530ed5313 (687a119d-c9c2-4222-a03f-979530ed5313): created successfully
Jul 09 09:20:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccae84c1-aa6e-4716-80e1-2dacb87fe01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:28 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Flow 'volume_create_manager' (4e6b10af-6c3a-4a43-b9b0-d2b7f447a80e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:28 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7cc077cd-31c8-4f0f-a8a5-606262357264 tempest-CreateVolumesFromSnapshotTest-962168302 None] Created volume successfully.
Jul 09 09:20:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-687a119d-c9c2-4222-a03f-979530ed5313-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-687a119d-c9c2-4222-a03f-979530ed5313-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-quobyte-687a119d-c9c2-4222-a03f-979530ed5313" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-687a119d-c9c2-4222-a03f-979530ed5313" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:28 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3340fe00-727b-4762-b249-e4a87d52ec5c]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:20:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-687a119d-c9c2-4222-a03f-979530ed5313 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:28 devstack sudo[104313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-687a119d-c9c2-4222-a03f-979530ed5313
Jul 09 09:20:28 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:29 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-687a119d-c9c2-4222-a03f-979530ed5313" returned: 0 in 0.729s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-687a119d-c9c2-4222-a03f-979530ed5313 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:29 devstack sudo[104319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-687a119d-c9c2-4222-a03f-979530ed5313
Jul 09 09:20:29 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:30 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-687a119d-c9c2-4222-a03f-979530ed5313" returned: 0 in 0.638s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:30 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-687a119d-c9c2-4222-a03f-979530ed5313" released by "delete_volume" :: held 1.406s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:30 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Created reservations ['9e0be9ac-7e8f-43f8-ab36-c7a6a50256ff', '6416250a-19af-42d7-b3aa-7cab273eb4fc', '79a68738-b615-40dc-b59e-d5c559afd52f', '65dc1b63-4bff-43eb-a7b3-ca5a7336bace'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:20:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:30 devstack sudo[104322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:20:30 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:30 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:30 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-8ff3429c-99f3-4972-bd28-7cc7a726f32e-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.644s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:30 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:20:30 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Deleted volume successfully.
Jul 09 09:20:30 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-8ff3429c-99f3-4972-bd28-7cc7a726f32e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9bc50ac3-7e9a-4c85-94a3-d5fc96f742e8 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-687a119d-c9c2-4222-a03f-979530ed5313-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-quobyte-8ff3429c-99f3-4972-bd28-7cc7a726f32e" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:31 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-8ff3429c-99f3-4972-bd28-7cc7a726f32e" acquired by "delete_volume" :: waited 0.013s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:31 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[083e6603-dc63-485f-94d2-bb235c3ec828]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:20:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:31 devstack sudo[104325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e
Jul 09 09:20:31 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:31 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e" returned: 0 in 0.751s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:31 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e
Jul 09 09:20:31 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:32 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-8ff3429c-99f3-4972-bd28-7cc7a726f32e" returned: 0 in 0.658s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-8ff3429c-99f3-4972-bd28-7cc7a726f32e" released by "delete_volume" :: held 1.446s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:32 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Created reservations ['9adc3cf6-c113-45fc-9f05-9cd53b5250dd', '8c213cb5-99b0-43cd-a979-df44464c8a94', '2fe984a4-8ec3-462e-8dc9-06ab278c38aa', '7dc586b3-d470-4086-8ec9-03334b9b73ba'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:20:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:32 devstack sudo[104333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:20:32 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-e9890093-2ec0-4b84-bdef-beef575a141d-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-e9890093-2ec0-4b84-bdef-beef575a141d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:33 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.658s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:33 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:20:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-quobyte-e9890093-2ec0-4b84-bdef-beef575a141d" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:33 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Deleted volume successfully.
Jul 09 09:20:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-e9890093-2ec0-4b84-bdef-beef575a141d" acquired by "delete_volume" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-249f984f-7299-48af-bd75-60d6a20c675c tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-8ff3429c-99f3-4972-bd28-7cc7a726f32e-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:33 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8fd8ce-3274-499e-b383-a853fcae6ca7]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:20:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9890093-2ec0-4b84-bdef-beef575a141d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:33 devstack sudo[104336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9890093-2ec0-4b84-bdef-beef575a141d
Jul 09 09:20:33 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:34 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9890093-2ec0-4b84-bdef-beef575a141d" returned: 0 in 0.734s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9890093-2ec0-4b84-bdef-beef575a141d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:34 devstack sudo[104347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9890093-2ec0-4b84-bdef-beef575a141d
Jul 09 09:20:34 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:34 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e9890093-2ec0-4b84-bdef-beef575a141d" returned: 0 in 0.633s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:34 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-e9890093-2ec0-4b84-bdef-beef575a141d" released by "delete_volume" :: held 1.407s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:34 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Created reservations ['2cfd9ab1-308f-45b6-b86c-b5da468eaec9', '2f3fe993-b034-4d37-b002-6880fd4a5959', 'd789b94e-f3a9-43c0-9cbc-9af60613f3d3', '8bbd67ce-52bd-4133-81d2-c2876382446a'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:20:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:34 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:34 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:34 devstack sudo[104350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:20:34 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-765e4e19-db8a-41ad-867e-4a4a3b9f5e58-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-765e4e19-db8a-41ad-867e-4a4a3b9f5e58-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:35 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.660s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:35 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:20:35 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Deleted volume successfully.
Jul 09 09:20:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-quobyte-765e4e19-db8a-41ad-867e-4a4a3b9f5e58" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-de7d27f9-2de2-49f4-b98d-90a9be3aa768 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-e9890093-2ec0-4b84-bdef-beef575a141d-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:35 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-765e4e19-db8a-41ad-867e-4a4a3b9f5e58" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:35 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd08cad6-0b62-4ab2-8701-b86ec17ccc6b]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:20:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:35 devstack sudo[104353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58
Jul 09 09:20:35 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:36 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58" returned: 0 in 0.737s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:36 devstack sudo[104358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58
Jul 09 09:20:36 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:36 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-765e4e19-db8a-41ad-867e-4a4a3b9f5e58" returned: 0 in 0.635s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-765e4e19-db8a-41ad-867e-4a4a3b9f5e58" released by "delete_volume" :: held 1.409s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:36 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Created reservations ['0f8a633d-1504-4724-a2fc-6a4cba263f56', 'fd4c0f81-7252-4bb5-9665-8240892da549', '91769974-1e23-4c8d-b522-ea66caa9836c', '179ce417-88a3-495e-9ba7-024a46e520a7'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:20:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:37 devstack sudo[104361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:20:37 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-a252a9d9-148b-4122-b77a-ae6eef73b58d-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:37 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.639s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:37 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:20:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-a252a9d9-148b-4122-b77a-ae6eef73b58d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:37 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Deleted volume successfully.
Jul 09 09:20:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7ea4cbb3-a3b4-43f2-965d-7a58d175b3ff tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-765e4e19-db8a-41ad-867e-4a4a3b9f5e58-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-quobyte-a252a9d9-148b-4122-b77a-ae6eef73b58d" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-a252a9d9-148b-4122-b77a-ae6eef73b58d" acquired by "delete_volume" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:37 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c726c770-bafe-45c1-85eb-07e7b5461dfe]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:20:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a252a9d9-148b-4122-b77a-ae6eef73b58d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:37 devstack sudo[104364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a252a9d9-148b-4122-b77a-ae6eef73b58d
Jul 09 09:20:37 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:38 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a252a9d9-148b-4122-b77a-ae6eef73b58d" returned: 0 in 0.736s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a252a9d9-148b-4122-b77a-ae6eef73b58d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:38 devstack sudo[104369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a252a9d9-148b-4122-b77a-ae6eef73b58d
Jul 09 09:20:38 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:39 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a252a9d9-148b-4122-b77a-ae6eef73b58d" returned: 0 in 0.622s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-a252a9d9-148b-4122-b77a-ae6eef73b58d" released by "delete_volume" :: held 1.393s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Created reservations ['08569ad9-dd3b-4688-8e80-d19cbbbefe94', '6d1233ab-bdaa-42ea-aaa3-6984ae742b75', '80d59265-2617-4551-abc4-222b8a3d438c', '50b1a0ff-5e68-4d12-8af3-9d736bb28727'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:39 devstack sudo[104372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:20:39 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-b9d27594-5a2a-46db-8011-56f712ac9465-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:39 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.642s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:20:39 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Deleted volume successfully.
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-b9d27594-5a2a-46db-8011-56f712ac9465-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-quobyte-2870bf99-936e-40b5-ba0d-8cfe72e1df67" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-2870bf99-936e-40b5-ba0d-8cfe72e1df67" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-quobyte-b9d27594-5a2a-46db-8011-56f712ac9465" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-949072cd-da95-4aaf-a909-3cada6c2d636 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-a252a9d9-148b-4122-b77a-ae6eef73b58d-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-b9d27594-5a2a-46db-8011-56f712ac9465" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Deleting offline snapshot b9d27594-5a2a-46db-8011-56f712ac9465 of volume 2870bf99-936e-40b5-ba0d-8cfe72e1df67 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] snapshot_file for this snap is: volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d4a26b-0b0c-417e-b365-89ddf8f02f84]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:20:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:40 devstack sudo[104376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465
Jul 09 09:20:40 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:40 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465" returned: 0 in 0.745s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:20:40 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a652aec4-da6c-4a99-8416-f76584796e0c]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:20:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:40 devstack sudo[104382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67
Jul 09 09:20:40 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:41 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67" returned: 0 in 0.753s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:41 devstack sudo[104387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465
Jul 09 09:20:41 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:42 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465" returned: 0 in 0.706s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:42 devstack sudo[104392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465
Jul 09 09:20:42 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:42 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67.b9d27594-5a2a-46db-8011-56f712ac9465" returned: 0 in 0.640s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-b9d27594-5a2a-46db-8011-56f712ac9465" released by "_delete_snapshot" :: held 2.938s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-2870bf99-936e-40b5-ba0d-8cfe72e1df67" released by "delete_snapshot" :: held 2.963s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:42 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Created reservations ['c5088fb6-d476-41c6-8bad-d08af3b92071', 'fb8930ed-196b-4e44-ab7d-6796727b5023', '31290893-19aa-4b26-b7ea-98884930f0db', '3ff23502-4a61-41db-9a9b-a50f26a38acf'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:20:42 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Delete snapshot completed successfully.
Jul 09 09:20:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-efe2b7f7-8b46-4370-bb93-bc4260f46cb0 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-b9d27594-5a2a-46db-8011-56f712ac9465-delete_snapshot" released by "delete_snapshot" :: held 3.085s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-2870bf99-936e-40b5-ba0d-8cfe72e1df67-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-2870bf99-936e-40b5-ba0d-8cfe72e1df67-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "cinder-quobyte-2870bf99-936e-40b5-ba0d-8cfe72e1df67" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-2870bf99-936e-40b5-ba0d-8cfe72e1df67" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:43 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0f20ea-896e-4122-9d94-9c8fdd5f9387]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:20:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:43 devstack sudo[104395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67
Jul 09 09:20:43 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:43 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67" returned: 0 in 0.734s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:43 devstack sudo[104400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67
Jul 09 09:20:43 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:44 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2870bf99-936e-40b5-ba0d-8cfe72e1df67" returned: 0 in 0.642s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-quobyte-2870bf99-936e-40b5-ba0d-8cfe72e1df67" released by "delete_volume" :: held 1.431s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:44 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Created reservations ['acc53ae6-6754-435f-91b3-26f7338eb4af', 'b19aa55a-c0ad-4246-8aca-f6cc5b876198', '627c7e66-71ab-4f39-bc88-9a6c230c1d17', '105a7246-abe1-41d4-96de-45f024663d1b'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:20:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:44 devstack sudo[104404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:20:44 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:45 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.636s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:45 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:20:45 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Deleted volume successfully.
Jul 09 09:20:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3074c611-2809-406c-8bbc-47404260e735 tempest-CreateVolumesFromSnapshotTest-962168302 None] Lock "cinder-2870bf99-936e-40b5-ba0d-8cfe72e1df67-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Flow 'volume_create_manager' (a85ba4d4-2eb0-4e22-a664-a015d8b7d200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693cc856-1c5e-492a-ab46-560863857958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693cc856-1c5e-492a-ab46-560863857958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-60786297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb56473d-177b-4d3f-8b9b-49ef8f3092a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922ab70b8e24b28b0aa1ee81c097b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:48Z,use_quota=True,user_id='21aa1a66623349d2af376cdabebd8256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602d9ad2-a3e1-4d84-b85a-aa0cf784534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602d9ad2-a3e1-4d84-b85a-aa0cf784534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913ee5d3-aceb-4c63-aba7-314c626b3e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913ee5d3-aceb-4c63-aba7-314c626b3e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb56473d-177b-4d3f-8b9b-49ef8f3092a4', 'volume_name': 'volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbf63ef-cd8c-4442-bcf8-d492e09e21a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bbf63ef-cd8c-4442-bcf8-d492e09e21a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa2e31a-f65a-4f95-8c9e-1f81770827e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:48 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Volume bb56473d-177b-4d3f-8b9b-49ef8f3092a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4', 'volume_size': 1}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-60786297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb56473d-177b-4d3f-8b9b-49ef8f3092a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922ab70b8e24b28b0aa1ee81c097b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:48Z,use_quota=True,user_id='21aa1a66623349d2af376cdabebd8256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Creating volume bb56473d-177b-4d3f-8b9b-49ef8f3092a4 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:20:48 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:20:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:48 devstack sudo[104407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4 1073741824
Jul 09 09:20:48 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:49 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4 1073741824" returned: 0 in 0.818s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:49 devstack sudo[104414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4
Jul 09 09:20:49 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:50 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4" returned: 0 in 0.624s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:20:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa2e31a-f65a-4f95-8c9e-1f81770827e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d380e1f-bbe1-46d3-88f3-e6c6ef124609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:50 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Volume volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4 (bb56473d-177b-4d3f-8b9b-49ef8f3092a4): created successfully
Jul 09 09:20:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d380e1f-bbe1-46d3-88f3-e6c6ef124609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Flow 'volume_create_manager' (a85ba4d4-2eb0-4e22-a664-a015d8b7d200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:50 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-581f59dc-c57b-4a4f-bc82-df48f082732e tempest-ProjectReaderTests-1628347461 None] Created volume successfully.
Jul 09 09:20:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Acquiring lock "cinder-bb56473d-177b-4d3f-8b9b-49ef8f3092a4-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Lock "cinder-bb56473d-177b-4d3f-8b9b-49ef8f3092a4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Acquiring lock "cinder-quobyte-bb56473d-177b-4d3f-8b9b-49ef8f3092a4" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Lock "cinder-quobyte-bb56473d-177b-4d3f-8b9b-49ef8f3092a4" acquired by "delete_volume" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:50 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6184a188-b704-4795-b39a-f6bf5ca6a5e6]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:20:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:50 devstack sudo[104417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4
Jul 09 09:20:50 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:51 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4" returned: 0 in 0.736s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:51 devstack sudo[104422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4
Jul 09 09:20:51 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:52 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bb56473d-177b-4d3f-8b9b-49ef8f3092a4" returned: 0 in 0.646s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:52 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Lock "cinder-quobyte-bb56473d-177b-4d3f-8b9b-49ef8f3092a4" released by "delete_volume" :: held 1.419s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:52 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Created reservations ['b1c25e96-ab66-43f3-9a20-88b16d1100d9', '5dd3d24a-2205-41c7-a81a-c42c09402482', '9d408e43-c8c6-449d-b2bd-0431ea2bdadd', 'bd732fd9-a0c6-4303-ac38-5442823ed51c'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:20:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:52 devstack sudo[104425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:20:52 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:52 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.645s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:52 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:20:52 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Deleted volume successfully.
Jul 09 09:20:52 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3f987806-ba35-42eb-bff0-d50b0c42001b tempest-ProjectReaderTests-1628347461 None] Lock "cinder-bb56473d-177b-4d3f-8b9b-49ef8f3092a4-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Flow 'volume_create_manager' (b9555b6c-85b7-4ba4-9630-7684a70c4941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9749454-cf8f-4cfc-9867-4ec84aabb057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9749454-cf8f-4cfc-9867-4ec84aabb057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-318892878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082b6445-51b3-47b0-9251-72a9a04f9292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922ab70b8e24b28b0aa1ee81c097b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:53Z,use_quota=True,user_id='21aa1a66623349d2af376cdabebd8256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfb6edc-f3f1-4ef3-aebc-73c59e2c2953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfb6edc-f3f1-4ef3-aebc-73c59e2c2953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402cf0d5-110e-4086-8e3e-828a703b8f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402cf0d5-110e-4086-8e3e-828a703b8f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082b6445-51b3-47b0-9251-72a9a04f9292', 'volume_name': 'volume-082b6445-51b3-47b0-9251-72a9a04f9292', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45637afc-5dad-4b07-820b-5ef28a9c32c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45637afc-5dad-4b07-820b-5ef28a9c32c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce5f047-542f-4735-8580-88522da19600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:53 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Volume 082b6445-51b3-47b0-9251-72a9a04f9292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082b6445-51b3-47b0-9251-72a9a04f9292', 'volume_size': 1}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-318892878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082b6445-51b3-47b0-9251-72a9a04f9292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6922ab70b8e24b28b0aa1ee81c097b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:20:53Z,use_quota=True,user_id='21aa1a66623349d2af376cdabebd8256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Creating volume 082b6445-51b3-47b0-9251-72a9a04f9292 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:20:53 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:20:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-082b6445-51b3-47b0-9251-72a9a04f9292 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:53 devstack sudo[104428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-082b6445-51b3-47b0-9251-72a9a04f9292 1073741824
Jul 09 09:20:53 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:54 devstack sudo[104434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:20:54 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:54 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-082b6445-51b3-47b0-9251-72a9a04f9292 1073741824" returned: 0 in 0.807s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-082b6445-51b3-47b0-9251-72a9a04f9292 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:54 devstack sudo[104436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-082b6445-51b3-47b0-9251-72a9a04f9292
Jul 09 09:20:54 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:54 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.637s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:20:54 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-082b6445-51b3-47b0-9251-72a9a04f9292" returned: 0 in 0.654s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce5f047-542f-4735-8580-88522da19600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082b6445-51b3-47b0-9251-72a9a04f9292', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d9c259c-f759-4dc7-a982-83e6e8318ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:20:54 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Volume volume-082b6445-51b3-47b0-9251-72a9a04f9292 (082b6445-51b3-47b0-9251-72a9a04f9292): created successfully
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d9c259c-f759-4dc7-a982-83e6e8318ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:20:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Flow 'volume_create_manager' (b9555b6c-85b7-4ba4-9630-7684a70c4941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:20:54 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-73a3647e-6c53-47cd-9be7-ae841b1a5a0f tempest-ProjectReaderTests-1628347461 None] Created volume successfully.
Jul 09 09:20:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Acquiring lock "cinder-082b6445-51b3-47b0-9251-72a9a04f9292-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Lock "cinder-082b6445-51b3-47b0-9251-72a9a04f9292-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Acquiring lock "cinder-quobyte-082b6445-51b3-47b0-9251-72a9a04f9292" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:20:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Lock "cinder-quobyte-082b6445-51b3-47b0-9251-72a9a04f9292" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:20:55 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d358e4-1159-4c02-9366-e82a803e4dea]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:20:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-082b6445-51b3-47b0-9251-72a9a04f9292 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:55 devstack sudo[104440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-082b6445-51b3-47b0-9251-72a9a04f9292
Jul 09 09:20:55 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:56 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-082b6445-51b3-47b0-9251-72a9a04f9292" returned: 0 in 0.749s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-082b6445-51b3-47b0-9251-72a9a04f9292 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:56 devstack sudo[104445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-082b6445-51b3-47b0-9251-72a9a04f9292
Jul 09 09:20:56 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:56 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-082b6445-51b3-47b0-9251-72a9a04f9292" returned: 0 in 0.667s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Lock "cinder-quobyte-082b6445-51b3-47b0-9251-72a9a04f9292" released by "delete_volume" :: held 1.454s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:20:56 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Created reservations ['c35638c2-667e-4629-bfc5-7b571c1e8a42', '3423c4b9-14a8-41ba-a86f-09ff63d0a55b', '258f4cf5-fb61-445c-940e-cbe943a0c204', '999c7105-613e-4dd5-9b30-3a6fac78c752'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:20:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:20:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:20:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:20:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:20:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:20:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:20:57 devstack sudo[104448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:20:57 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:20:57 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root
Jul 09 09:20:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.640s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:20:57 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:20:57 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Deleted volume successfully.
Jul 09 09:20:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-06d55b68-e5cb-441a-b980-bc56e127ffaa tempest-ProjectReaderTests-1628347461 None] Lock "cinder-082b6445-51b3-47b0-9251-72a9a04f9292-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=76,cinder:INSERT=28,cinder:UPDATE=111,cinder:DELETE=14 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=75,cinder:UPDATE=112,cinder:INSERT=25,cinder:DELETE=5 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Flow 'volume_create_manager' (4d8351d0-67b5-45e7-ad31-27acb16cbd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e8e288-4e1d-44ca-adf3-1726e03a7c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e8e288-4e1d-44ca-adf3-1726e03a7c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-289288314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e02bab0-64ed-4aad-bb30-11e4d7268ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f8a6a7fad14b6ca27efcc1d2d7e1c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:05Z,use_quota=True,user_id='1e2754417e3c47eaa489ac9daf615e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d301a5-92e1-4218-9ddb-17a066e7d275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d301a5-92e1-4218-9ddb-17a066e7d275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70db601-1bc3-4e66-8dd2-fb21efa8c3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70db601-1bc3-4e66-8dd2-fb21efa8c3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e02bab0-64ed-4aad-bb30-11e4d7268ab9', 'volume_name': 'volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2def9e5-6b26-4951-a597-abf0603a01d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2def9e5-6b26-4951-a597-abf0603a01d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9192b6f7-6f3b-4096-93b6-3e148026d24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:05 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Volume 3e02bab0-64ed-4aad-bb30-11e4d7268ab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9', 'volume_size': 1}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-289288314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e02bab0-64ed-4aad-bb30-11e4d7268ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f8a6a7fad14b6ca27efcc1d2d7e1c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:05Z,use_quota=True,user_id='1e2754417e3c47eaa489ac9daf615e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Creating volume 3e02bab0-64ed-4aad-bb30-11e4d7268ab9 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:05 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:05 devstack sudo[104456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9 1073741824
Jul 09 09:21:05 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:06 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9 1073741824" returned: 0 in 0.781s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:06 devstack sudo[104462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9
Jul 09 09:21:06 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:06 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9" returned: 0 in 0.634s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:06 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:21:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9192b6f7-6f3b-4096-93b6-3e148026d24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270dda5b-24e0-4c56-aa0a-93b0c0b53d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:06 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Volume volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9 (3e02bab0-64ed-4aad-bb30-11e4d7268ab9): created successfully
Jul 09 09:21:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270dda5b-24e0-4c56-aa0a-93b0c0b53d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Flow 'volume_create_manager' (4d8351d0-67b5-45e7-ad31-27acb16cbd47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:06 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b302f423-16bb-4065-81c4-75dd69b22f40 tempest-ProjectReaderTests-1929676334 None] Created volume successfully.
Jul 09 09:21:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Acquiring lock "cinder-3e02bab0-64ed-4aad-bb30-11e4d7268ab9-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Lock "cinder-3e02bab0-64ed-4aad-bb30-11e4d7268ab9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Acquiring lock "cinder-quobyte-3e02bab0-64ed-4aad-bb30-11e4d7268ab9" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Lock "cinder-quobyte-3e02bab0-64ed-4aad-bb30-11e4d7268ab9" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:07 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa11ac8-a02c-42b9-8884-7c7c52bee32d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:07 devstack sudo[104465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9
Jul 09 09:21:07 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:08 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9" returned: 0 in 0.717s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:08 devstack sudo[104470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9
Jul 09 09:21:08 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:08 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-3e02bab0-64ed-4aad-bb30-11e4d7268ab9" returned: 0 in 0.610s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Lock "cinder-quobyte-3e02bab0-64ed-4aad-bb30-11e4d7268ab9" released by "delete_volume" :: held 1.365s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:08 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Created reservations ['e3592747-a1d8-4bfe-a4e2-296d6c828fad', 'd719cc76-ac6f-4396-805f-657de8674734', '0a660506-e32e-4930-926f-c8220fda898c', '5715519a-23f0-4237-a1d9-50927d012ed3'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:21:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:08 devstack sudo[104473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:21:08 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:09 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.609s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:09 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:21:09 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Deleted volume successfully.
Jul 09 09:21:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8c83e7c2-5bdc-400f-a5e4-8014dc83ff2e tempest-ProjectReaderTests-1929676334 None] Lock "cinder-3e02bab0-64ed-4aad-bb30-11e4d7268ab9-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:09 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Flow 'volume_create_manager' (16a6e8ae-2eb9-42f9-927e-7d130eeca3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:09 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec16ad0e-3117-4217-86e4-42266685c497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec16ad0e-3117-4217-86e4-42266685c497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-818978187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f8a6a7fad14b6ca27efcc1d2d7e1c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:10Z,use_quota=True,user_id='1e2754417e3c47eaa489ac9daf615e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82485cf3-4da6-4a88-9f35-fc1dcf6f8c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82485cf3-4da6-4a88-9f35-fc1dcf6f8c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a689ffef-00c4-4bbd-95e1-6f74ba24911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a689ffef-00c4-4bbd-95e1-6f74ba24911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8', 'volume_name': 'volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa473fe0-c805-43e6-8c52-41f68feaea9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa473fe0-c805-43e6-8c52-41f68feaea9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba041de1-3641-44d5-a558-25d8b0776321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:10 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Volume 931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8', 'volume_size': 1}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-818978187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f8a6a7fad14b6ca27efcc1d2d7e1c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:10Z,use_quota=True,user_id='1e2754417e3c47eaa489ac9daf615e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Creating volume 931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:10 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:10 devstack sudo[104477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8 1073741824
Jul 09 09:21:10 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:10 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8 1073741824" returned: 0 in 0.777s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:10 devstack sudo[104483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8
Jul 09 09:21:10 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:11 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8" returned: 0 in 0.616s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:21:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba041de1-3641-44d5-a558-25d8b0776321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00fda7a-c715-4fc5-b4c1-6126ff418bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:11 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Volume volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8 (931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8): created successfully
Jul 09 09:21:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00fda7a-c715-4fc5-b4c1-6126ff418bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Flow 'volume_create_manager' (16a6e8ae-2eb9-42f9-927e-7d130eeca3a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:11 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-fb859f09-fd73-483f-b9b4-0c668d012ee7 tempest-ProjectReaderTests-1929676334 None] Created volume successfully.
Jul 09 09:21:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Acquiring lock "cinder-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Lock "cinder-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Acquiring lock "cinder-quobyte-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Lock "cinder-quobyte-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:12 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fb6fa6-46c1-4d3f-bd72-08a2ab866426]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:12 devstack sudo[104486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8
Jul 09 09:21:12 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:12 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8" returned: 0 in 0.723s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:12 devstack sudo[104491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8
Jul 09 09:21:12 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:13 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8" returned: 0 in 0.631s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Lock "cinder-quobyte-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8" released by "delete_volume" :: held 1.390s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:13 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Created reservations ['be6cdd08-23b7-440d-807a-32834e38cd32', '3d2a873c-72e1-43fd-895c-669f6f14349f', '3698a4b6-f6cd-4baa-b9ea-8c8db432eb6f', '263c9b61-2958-4fa2-babd-3aac862d7f34'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:21:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:13 devstack sudo[104494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:21:13 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:14 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.640s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:21:14 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Deleted volume successfully.
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7a275379-f11a-42bf-9226-4a832be47cef tempest-ProjectReaderTests-1929676334 None] Lock "cinder-931a25a2-3ca0-4964-b8ca-6b1e4c1ceeb8-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Flow 'volume_create_manager' (c1f0ccad-c739-4a76-9d9e-c6e11f4597b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38214fcb-ab1c-4b7c-b2f1-5e042ee478e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38214fcb-ab1c-4b7c-b2f1-5e042ee478e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-96400707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa617cdc-6b94-4c9d-b25e-43c8933d129b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f8a6a7fad14b6ca27efcc1d2d7e1c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:15Z,use_quota=True,user_id='1e2754417e3c47eaa489ac9daf615e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10755235-cf46-4711-80ce-fe627fef3c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10755235-cf46-4711-80ce-fe627fef3c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de39be3-d9b6-4fbf-bb46-14538e7a507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de39be3-d9b6-4fbf-bb46-14538e7a507a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa617cdc-6b94-4c9d-b25e-43c8933d129b', 'volume_name': 'volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffffe45-beb6-4a07-9598-a07b8260fc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffffe45-beb6-4a07-9598-a07b8260fc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26194371-4a18-4585-a3e2-f0e19ad6e6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:14 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Volume aa617cdc-6b94-4c9d-b25e-43c8933d129b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b', 'volume_size': 1}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-96400707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa617cdc-6b94-4c9d-b25e-43c8933d129b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f8a6a7fad14b6ca27efcc1d2d7e1c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:15Z,use_quota=True,user_id='1e2754417e3c47eaa489ac9daf615e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Creating volume aa617cdc-6b94-4c9d-b25e-43c8933d129b {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:14 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:14 devstack sudo[104497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b 1073741824
Jul 09 09:21:14 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:15 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b 1073741824" returned: 0 in 0.776s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:15 devstack sudo[104503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b
Jul 09 09:21:15 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:16 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b" returned: 0 in 0.623s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:21:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26194371-4a18-4585-a3e2-f0e19ad6e6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f6bce9-7f6d-49c8-8cc6-5c80db625a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:16 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Volume volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b (aa617cdc-6b94-4c9d-b25e-43c8933d129b): created successfully
Jul 09 09:21:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f6bce9-7f6d-49c8-8cc6-5c80db625a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Flow 'volume_create_manager' (c1f0ccad-c739-4a76-9d9e-c6e11f4597b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:16 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-4e070d92-7ef5-4868-b7e9-d4f7deccc283 tempest-ProjectReaderTests-1929676334 None] Created volume successfully.
Jul 09 09:21:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Acquiring lock "cinder-aa617cdc-6b94-4c9d-b25e-43c8933d129b-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Lock "cinder-aa617cdc-6b94-4c9d-b25e-43c8933d129b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Acquiring lock "cinder-quobyte-aa617cdc-6b94-4c9d-b25e-43c8933d129b" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Lock "cinder-quobyte-aa617cdc-6b94-4c9d-b25e-43c8933d129b" acquired by "delete_volume" :: waited 0.013s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:16 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[98690b39-7079-4d60-96a4-02ae11c54ab9]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:17 devstack sudo[104506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b
Jul 09 09:21:17 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:17 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b" returned: 0 in 0.736s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:17 devstack sudo[104511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b
Jul 09 09:21:17 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:18 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-aa617cdc-6b94-4c9d-b25e-43c8933d129b" returned: 0 in 0.623s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Lock "cinder-quobyte-aa617cdc-6b94-4c9d-b25e-43c8933d129b" released by "delete_volume" :: held 1.394s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:18 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Created reservations ['2d8590c4-74f5-4342-a83c-e5be2acb5bce', 'a0b29110-db39-49be-81f8-7a20e42c0c6b', 'a87d01c8-e8c5-451a-8f28-d51afacdbf3e', '4bdd632c-d2bb-47a3-a871-e8458fd70f8f'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:21:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:18 devstack sudo[104514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:21:18 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:19 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.634s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:21:19 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Deleted volume successfully.
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-265607bb-a0b0-4a38-a744-6954af9312c0 tempest-ProjectReaderTests-1929676334 None] Lock "cinder-aa617cdc-6b94-4c9d-b25e-43c8933d129b-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Flow 'volume_create_manager' (b2b92460-7299-4b23-b12f-56d9088a5218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39029fde-5b88-42f7-8c36-558049da225e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39029fde-5b88-42f7-8c36-558049da225e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-126526293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e21a061-1d66-4514-883b-7e161e08f15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f8a6a7fad14b6ca27efcc1d2d7e1c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:19Z,use_quota=True,user_id='1e2754417e3c47eaa489ac9daf615e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4102e8c1-9f37-42c5-88df-af83dad83ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4102e8c1-9f37-42c5-88df-af83dad83ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d5ae11-9112-4a53-8430-1b946ffaa2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d5ae11-9112-4a53-8430-1b946ffaa2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e21a061-1d66-4514-883b-7e161e08f15f', 'volume_name': 'volume-2e21a061-1d66-4514-883b-7e161e08f15f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92937362-7f5e-4660-80ff-c3a8c034c11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92937362-7f5e-4660-80ff-c3a8c034c11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a12ba13-5d57-4042-9e9f-5317fd32beda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:19 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Volume 2e21a061-1d66-4514-883b-7e161e08f15f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e21a061-1d66-4514-883b-7e161e08f15f', 'volume_size': 1}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-126526293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e21a061-1d66-4514-883b-7e161e08f15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84f8a6a7fad14b6ca27efcc1d2d7e1c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:19Z,use_quota=True,user_id='1e2754417e3c47eaa489ac9daf615e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Creating volume 2e21a061-1d66-4514-883b-7e161e08f15f {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:19 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2e21a061-1d66-4514-883b-7e161e08f15f 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:19 devstack sudo[104518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2e21a061-1d66-4514-883b-7e161e08f15f 1073741824
Jul 09 09:21:19 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:20 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2e21a061-1d66-4514-883b-7e161e08f15f 1073741824" returned: 0 in 0.775s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2e21a061-1d66-4514-883b-7e161e08f15f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:20 devstack sudo[104524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2e21a061-1d66-4514-883b-7e161e08f15f
Jul 09 09:21:20 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:20 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2e21a061-1d66-4514-883b-7e161e08f15f" returned: 0 in 0.629s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:21:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a12ba13-5d57-4042-9e9f-5317fd32beda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e21a061-1d66-4514-883b-7e161e08f15f', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f784a0-c60d-4307-9799-6ad53a147291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:21 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Volume volume-2e21a061-1d66-4514-883b-7e161e08f15f (2e21a061-1d66-4514-883b-7e161e08f15f): created successfully
Jul 09 09:21:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f784a0-c60d-4307-9799-6ad53a147291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:21 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Flow 'volume_create_manager' (b2b92460-7299-4b23-b12f-56d9088a5218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:21 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7f607304-f034-4d56-a7b9-205e61c2e46a tempest-ProjectReaderTests-1929676334 None] Created volume successfully.
Jul 09 09:21:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Acquiring lock "cinder-2e21a061-1d66-4514-883b-7e161e08f15f-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Lock "cinder-2e21a061-1d66-4514-883b-7e161e08f15f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Acquiring lock "cinder-quobyte-2e21a061-1d66-4514-883b-7e161e08f15f" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Lock "cinder-quobyte-2e21a061-1d66-4514-883b-7e161e08f15f" acquired by "delete_volume" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:21 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[80996994-0e14-4a38-b218-29f8a697c995]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2e21a061-1d66-4514-883b-7e161e08f15f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:21 devstack sudo[104527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2e21a061-1d66-4514-883b-7e161e08f15f
Jul 09 09:21:21 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:22 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2e21a061-1d66-4514-883b-7e161e08f15f" returned: 0 in 0.741s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2e21a061-1d66-4514-883b-7e161e08f15f {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:22 devstack sudo[104532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2e21a061-1d66-4514-883b-7e161e08f15f
Jul 09 09:21:22 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:23 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2e21a061-1d66-4514-883b-7e161e08f15f" returned: 0 in 0.615s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Lock "cinder-quobyte-2e21a061-1d66-4514-883b-7e161e08f15f" released by "delete_volume" :: held 1.394s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:23 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Created reservations ['8e0400f3-847c-49e6-b370-1c292f7993a6', '74793437-daa0-428f-81fd-71ace574fdb8', 'd2669a6a-2845-4ecd-b131-76bdd7c314ab', '2033ef85-2cbd-40e8-8068-d48fb84cf380'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:21:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:23 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:23 devstack sudo[104537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:21:23 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:23 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.648s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:23 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:21:23 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Deleted volume successfully.
Jul 09 09:21:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f20f5174-a30f-460d-9ae7-4ec5a979c40e tempest-ProjectReaderTests-1929676334 None] Lock "cinder-2e21a061-1d66-4514-883b-7e161e08f15f-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:33 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=44,cinder:DELETE=5 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:21:33 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=30,cinder:UPDATE=43,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Flow 'volume_create_manager' (724f0876-f260-4c1b-b1a2-1c5931fb01b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6828a8cf-9ced-4c02-b88e-10730369c2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6828a8cf-9ced-4c02-b88e-10730369c2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1596936581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553e9ae19c324947b3c38d3a5ea45ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:36Z,use_quota=True,user_id='2e7bbed3055d41d5852e703880b7d640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c695f73e-5294-444e-854f-60e7a3286fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c695f73e-5294-444e-854f-60e7a3286fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff22b0a7-75b3-4a11-9377-274f661db99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff22b0a7-75b3-4a11-9377-274f661db99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7', 'volume_name': 'volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9f974a-b6a6-446e-9115-07215ad2d2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9f974a-b6a6-446e-9115-07215ad2d2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9569aa-0ded-42ab-b735-6de4c125444c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Volume 2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7', 'volume_size': 1}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1596936581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553e9ae19c324947b3c38d3a5ea45ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:36Z,use_quota=True,user_id='2e7bbed3055d41d5852e703880b7d640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Creating volume 2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:36 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:36 devstack sudo[104622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7 1073741824
Jul 09 09:21:36 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Flow 'volume_create_manager' (f58bc096-dbbf-4fce-8e0b-75fff573004b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d93bf99b-7039-47dc-935a-a7109966aa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d93bf99b-7039-47dc-935a-a7109966aa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-199066808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73da80d0-a3ee-4e6c-88fe-f9c360970a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec985cc5b3243d1961285ae8ef52c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:36Z,use_quota=True,user_id='f208bcb64ca14acfa871102f2f62cfa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1b8f7b-9ebf-4a00-8c55-95630e47dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1b8f7b-9ebf-4a00-8c55-95630e47dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125ff355-274c-41b7-ad16-cb32c03e559e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125ff355-274c-41b7-ad16-cb32c03e559e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73da80d0-a3ee-4e6c-88fe-f9c360970a87', 'volume_name': 'volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890da502-6ce9-44f2-8352-0bd03480b6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890da502-6ce9-44f2-8352-0bd03480b6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ead1faa-9541-4e92-90e1-27f4ce9bf0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume 73da80d0-a3ee-4e6c-88fe-f9c360970a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87', 'volume_size': 1}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Flow 'volume_create_manager' (386d6067-5006-4ac3-838c-39af41478d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0e1cf8-1919-484d-b4dc-2686a6caa254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0e1cf8-1919-484d-b4dc-2686a6caa254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-745357679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac7df44-bc3f-4796-8702-ff4a3b97133b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553e9ae19c324947b3c38d3a5ea45ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:36Z,use_quota=True,user_id='2e7bbed3055d41d5852e703880b7d640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a56d937-83e1-47e3-8109-57f114e78b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a56d937-83e1-47e3-8109-57f114e78b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681ff9eb-74fc-47de-8da5-1be0c40bb198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681ff9eb-74fc-47de-8da5-1be0c40bb198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dac7df44-bc3f-4796-8702-ff4a3b97133b', 'volume_name': 'volume-dac7df44-bc3f-4796-8702-ff4a3b97133b', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4950f2e-5d14-4b25-a30a-b925c57bfc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4950f2e-5d14-4b25-a30a-b925c57bfc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd5429a-5913-4704-b462-4c894dc236ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Volume dac7df44-bc3f-4796-8702-ff4a3b97133b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dac7df44-bc3f-4796-8702-ff4a3b97133b', 'volume_size': 1}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Flow 'volume_create_manager' (3c45b230-6824-4bed-82a9-91bad50bad9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4715ae3-bb7b-44fe-b887-8648cc89fc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4715ae3-bb7b-44fe-b887-8648cc89fc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-614757364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ab8ac5-7ed6-4756-b67a-c48b949fef41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553e9ae19c324947b3c38d3a5ea45ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:37Z,use_quota=True,user_id='2e7bbed3055d41d5852e703880b7d640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8639c8-5e2c-4976-925f-0253baaf3b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8639c8-5e2c-4976-925f-0253baaf3b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007dd886-8c9b-4262-9b92-37559f5e34d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007dd886-8c9b-4262-9b92-37559f5e34d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ab8ac5-7ed6-4756-b67a-c48b949fef41', 'volume_name': 'volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735d5993-a353-4d3d-a66e-e345559fe7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735d5993-a353-4d3d-a66e-e345559fe7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bb3155-98db-459b-b437-d881febf7430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:37 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Volume 67ab8ac5-7ed6-4756-b67a-c48b949fef41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41', 'volume_size': 1}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Flow 'volume_create_manager' (f30ec101-3d44-40e4-a51b-71dbe5c43460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ed6413-3258-4da9-b50c-ace6193b79da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ed6413-3258-4da9-b50c-ace6193b79da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1917843692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c2168a-192b-41b9-baab-1f55b882a3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553e9ae19c324947b3c38d3a5ea45ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:37Z,use_quota=True,user_id='2e7bbed3055d41d5852e703880b7d640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d32b171-2a1a-495d-9e71-75b372ef4856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d32b171-2a1a-495d-9e71-75b372ef4856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c31b098-98cb-42dc-baee-4d2dfd3d7ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c31b098-98cb-42dc-baee-4d2dfd3d7ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c2168a-192b-41b9-baab-1f55b882a3c6', 'volume_name': 'volume-72c2168a-192b-41b9-baab-1f55b882a3c6', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889ff4df-6fb4-49e5-83c9-a1ce60e9c1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889ff4df-6fb4-49e5-83c9-a1ce60e9c1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8739dffb-4865-4f0c-95f5-9d0fbb9b448b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:37 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Volume 72c2168a-192b-41b9-baab-1f55b882a3c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c2168a-192b-41b9-baab-1f55b882a3c6', 'volume_size': 1}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:37 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7 1073741824" returned: 0 in 1.242s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:37 devstack sudo[104628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7
Jul 09 09:21:37 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Flow 'volume_create_manager' (c44866d8-b360-4e22-a943-c85bfc68a079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab05e345-1206-4dd9-8d45-005a6d118605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab05e345-1206-4dd9-8d45-005a6d118605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1695346289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d644a66-3c16-4926-aa0e-bfa1d6537443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553e9ae19c324947b3c38d3a5ea45ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:38Z,use_quota=True,user_id='2e7bbed3055d41d5852e703880b7d640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6849bbf-0988-4b39-bca6-22b6ff1eb7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6849bbf-0988-4b39-bca6-22b6ff1eb7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e768ff-c545-4f0f-81be-6175210ca7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e768ff-c545-4f0f-81be-6175210ca7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d644a66-3c16-4926-aa0e-bfa1d6537443', 'volume_name': 'volume-4d644a66-3c16-4926-aa0e-bfa1d6537443', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51ca79d-7d7f-47c0-bcea-81b243341896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51ca79d-7d7f-47c0-bcea-81b243341896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e305b51e-209e-469a-aac5-db4aa5ca5872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:38 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Volume 4d644a66-3c16-4926-aa0e-bfa1d6537443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d644a66-3c16-4926-aa0e-bfa1d6537443', 'volume_size': 1}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:38 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7" returned: 0 in 0.793s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.645s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-199066808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73da80d0-a3ee-4e6c-88fe-f9c360970a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec985cc5b3243d1961285ae8ef52c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:36Z,use_quota=True,user_id='f208bcb64ca14acfa871102f2f62cfa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Creating volume 73da80d0-a3ee-4e6c-88fe-f9c360970a87 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:38 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9569aa-0ded-42ab-b735-6de4c125444c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:38 devstack sudo[104631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87 1073741824
Jul 09 09:21:38 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc024ad7-268f-4a56-ae6f-96df9dc9c8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:38 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Volume volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7 (2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7): created successfully
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc024ad7-268f-4a56-ae6f-96df9dc9c8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Flow 'volume_create_manager' (724f0876-f260-4c1b-b1a2-1c5931fb01b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:38 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-34d78260-f238-4d4a-b715-603f64d5a7a8 tempest-CreateVolumesFromImageTest-1740969168 None] Created volume successfully.
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Flow 'volume_create_manager' (6a49ef4a-5d84-4bcd-b082-905a128ddd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626f8905-2eb4-44e1-8bf3-b572f4c0f750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626f8905-2eb4-44e1-8bf3-b572f4c0f750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942294c4-24e5-4f47-ba91-791b9418bb6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2492942e07049b0b0d467829b2e6ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:39Z,use_quota=True,user_id='0d8bbda529104582bb5d6f33cbab4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6879eb0c-d3cc-4fc8-8c87-27062da1fee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6879eb0c-d3cc-4fc8-8c87-27062da1fee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22098026-91e5-4eba-ad95-400d1cec177d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG cinder.image.glance [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Creating Keystone auth plugin from conf {{(pid=87009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 09:21:39 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87 1073741824" returned: 0 in 0.998s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:39 devstack sudo[104638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87
Jul 09 09:21:39 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22098026-91e5-4eba-ad95-400d1cec177d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '942294c4-24e5-4f47-ba91-791b9418bb6c', 'volume_name': 'volume-942294c4-24e5-4f47-ba91-791b9418bb6c', 'volume_size': 1, 'image_id': 'ff324b0a-a641-4371-9273-9ad9642518e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff324b0a-a641-4371-9273-9ad9642518e2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '95c29381916c3f6ead5adca7d3e683f1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2492942e07049b0b0d467829b2e6ee7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e93d13f7b1be5eebb6e34575cf15c75976a5ee6d9ce546eecfb342c45d76299cfdf933b2f0b033ba65f444a830909137c1cf4b16f8a1bb942013c0c32683986a', 'id': 'ff324b0a-a641-4371-9273-9ad9642518e2', 'created_at': datetime.datetime(2026, 7, 9, 7, 21, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 21, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff324b0a-a641-4371-9273-9ad9642518e2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a6e3290>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c232b56a-c912-4540-920d-ed19f8b2d2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c232b56a-c912-4540-920d-ed19f8b2d2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85826a1d-12e5-402a-9b80-494f77dca45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:39 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Volume 942294c4-24e5-4f47-ba91-791b9418bb6c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-942294c4-24e5-4f47-ba91-791b9418bb6c', 'volume_size': 1, 'image_id': 'ff324b0a-a641-4371-9273-9ad9642518e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff324b0a-a641-4371-9273-9ad9642518e2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '95c29381916c3f6ead5adca7d3e683f1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2492942e07049b0b0d467829b2e6ee7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e93d13f7b1be5eebb6e34575cf15c75976a5ee6d9ce546eecfb342c45d76299cfdf933b2f0b033ba65f444a830909137c1cf4b16f8a1bb942013c0c32683986a', 'id': 'ff324b0a-a641-4371-9273-9ad9642518e2', 'created_at': datetime.datetime(2026, 7, 9, 7, 21, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 21, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff324b0a-a641-4371-9273-9ad9642518e2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a6e3290>}
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Trying to clone 942294c4-24e5-4f47-ba91-791b9418bb6c from image ff324b0a-a641-4371-9273-9ad9642518e2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ff324b0a-a641-4371-9273-9ad9642518e2', 'metadata': {}}]). {{(pid=87009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 09:21:39 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Image download 0.00 MB at 0.00 MB/s
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6ad9f6-fd45-4754-99f7-f98ad1064d4f]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:39 devstack sudo[104640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD
Jul 09 09:21:39 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:40 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87" returned: 0 in 0.707s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.174s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-745357679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac7df44-bc3f-4796-8702-ff4a3b97133b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553e9ae19c324947b3c38d3a5ea45ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:36Z,use_quota=True,user_id='2e7bbed3055d41d5852e703880b7d640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Creating volume dac7df44-bc3f-4796-8702-ff4a3b97133b {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:40 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dac7df44-bc3f-4796-8702-ff4a3b97133b 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ead1faa-9541-4e92-90e1-27f4ce9bf0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d968ab00-9dd0-48d8-ae44-dec21f3f9e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:40 devstack sudo[104643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dac7df44-bc3f-4796-8702-ff4a3b97133b 1073741824
Jul 09 09:21:40 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:40 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87 (73da80d0-a3ee-4e6c-88fe-f9c360970a87): created successfully
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d968ab00-9dd0-48d8-ae44-dec21f3f9e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Flow 'volume_create_manager' (f58bc096-dbbf-4fce-8e0b-75fff573004b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:40 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-8a7df060-59a0-4184-ac65-354143aa49c4 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Created volume successfully.
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Flow 'volume_create_manager' (48cb60ca-8b3b-4a5c-b9a3-d8241c1a3630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbce92a3-cedf-464f-aa6b-7a97999e5376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbce92a3-cedf-464f-aa6b-7a97999e5376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=447ddc11-b593-40c6-95fa-c2325015a76d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f5192bf9c745fea94de93035307fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:40Z,use_quota=True,user_id='54e9f5ab6fe84f758279473749f14a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f415c8f1-0915-4f09-9c9d-afa1f92eaff8),volume_type_id=f415c8f1-0915-4f09-9c9d-afa1f92eaff8)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281ca15b-aab6-4ce9-8803-e0cf266ec44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281ca15b-aab6-4ce9-8803-e0cf266ec44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8dbd9b-5403-4106-9381-374888cd89bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.image.glance [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Creating Keystone auth plugin from conf {{(pid=87009) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 09 09:21:40 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD" returned: 0 in 0.813s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:40 devstack sudo[104647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD
Jul 09 09:21:40 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8dbd9b-5403-4106-9381-374888cd89bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '447ddc11-b593-40c6-95fa-c2325015a76d', 'volume_name': 'volume-447ddc11-b593-40c6-95fa-c2325015a76d', 'volume_size': 1, 'image_id': '2de410a6-8e05-448a-ab40-dfdb26eaa1ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2de410a6-8e05-448a-ab40-dfdb26eaa1ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e8b3afe8d8738c537345d005f4d3200b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '46f5192bf9c745fea94de93035307fb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b00e0dca38e021cc17848f73df2f5b637d48370e315e8c9c6e5452562f8e9b9a9f25effd82da31aacf5e28bcfd707c0b43c64e117e309dfe638e68d6f32b1cf4', 'id': '2de410a6-8e05-448a-ab40-dfdb26eaa1ca', 'created_at': datetime.datetime(2026, 7, 9, 7, 21, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 21, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2de410a6-8e05-448a-ab40-dfdb26eaa1ca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a49c1d0>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabd6e62-b3cd-4042-a4b2-2f94c9cea443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabd6e62-b3cd-4042-a4b2-2f94c9cea443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b08f478-50fb-4b4e-b322-6ca3b13e12ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:40 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Volume 447ddc11-b593-40c6-95fa-c2325015a76d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-447ddc11-b593-40c6-95fa-c2325015a76d', 'volume_size': 1, 'image_id': '2de410a6-8e05-448a-ab40-dfdb26eaa1ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2de410a6-8e05-448a-ab40-dfdb26eaa1ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e8b3afe8d8738c537345d005f4d3200b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '46f5192bf9c745fea94de93035307fb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b00e0dca38e021cc17848f73df2f5b637d48370e315e8c9c6e5452562f8e9b9a9f25effd82da31aacf5e28bcfd707c0b43c64e117e309dfe638e68d6f32b1cf4', 'id': '2de410a6-8e05-448a-ab40-dfdb26eaa1ca', 'created_at': datetime.datetime(2026, 7, 9, 7, 21, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 21, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2de410a6-8e05-448a-ab40-dfdb26eaa1ca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a49c1d0>}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Trying to clone 447ddc11-b593-40c6-95fa-c2325015a76d from image 2de410a6-8e05-448a-ab40-dfdb26eaa1ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/2de410a6-8e05-448a-ab40-dfdb26eaa1ca', 'metadata': {}}]). {{(pid=87009) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 09 09:21:40 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Image download 0.00 MB at 0.00 MB/s
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1443cd30-636a-408a-8a71-92b6abe0c656]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:40 devstack sudo[104651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD
Jul 09 09:21:40 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:41 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dac7df44-bc3f-4796-8702-ff4a3b97133b 1073741824" returned: 0 in 0.980s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dac7df44-bc3f-4796-8702-ff4a3b97133b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:41 devstack sudo[104658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dac7df44-bc3f-4796-8702-ff4a3b97133b
Jul 09 09:21:41 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:41 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD" returned: 1 in 0.765s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Temporary image ff324b0a-a641-4371-9273-9ad9642518e2 is fetched for user 0d8bbda529104582bb5d6f33cbab4ae7. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c0f36d-3e39-4573-a65f-8969cf75bcd7]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:41 devstack sudo[104660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD
Jul 09 09:21:41 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:41 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:41 devstack sudo[104664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD
Jul 09 09:21:41 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:41 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dac7df44-bc3f-4796-8702-ff4a3b97133b" returned: 0 in 0.651s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.740s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-614757364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ab8ac5-7ed6-4756-b67a-c48b949fef41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553e9ae19c324947b3c38d3a5ea45ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:37Z,use_quota=True,user_id='2e7bbed3055d41d5852e703880b7d640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Creating volume 67ab8ac5-7ed6-4756-b67a-c48b949fef41 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:41 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:41 devstack sudo[104667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41 1073741824
Jul 09 09:21:41 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd5429a-5913-4704-b462-4c894dc236ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dac7df44-bc3f-4796-8702-ff4a3b97133b', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed547f0-88b9-4369-bb4a-465a245000c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:41 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Volume volume-dac7df44-bc3f-4796-8702-ff4a3b97133b (dac7df44-bc3f-4796-8702-ff4a3b97133b): created successfully
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed547f0-88b9-4369-bb4a-465a245000c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Flow 'volume_create_manager' (386d6067-5006-4ac3-838c-39af41478d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:41 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-6ce1352b-4c18-44a9-b4fe-7aabcdd7da80 tempest-CreateVolumesFromImageTest-1740969168 None] Created volume successfully.
Jul 09 09:21:42 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD" returned: 0 in 0.743s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:42 devstack sudo[104671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD
Jul 09 09:21:42 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:42 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD" returned: 1 in 0.758s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:21:42 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Temporary image 2de410a6-8e05-448a-ab40-dfdb26eaa1ca is fetched for user 54e9f5ab6fe84f758279473749f14a2f. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 09 09:21:42 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69f585a-f767-4658-93ba-7dc5f69542c2]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:42 devstack sudo[104679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD
Jul 09 09:21:42 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:42 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41 1073741824" returned: 0 in 0.869s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:42 devstack sudo[104682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41
Jul 09 09:21:42 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:42 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD" returned: 1 in 0.806s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:21:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:43 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD" returned: 0 in 0.770s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:43 devstack sudo[104689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD
Jul 09 09:21:43 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:43 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41" returned: 0 in 0.650s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.952s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1917843692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c2168a-192b-41b9-baab-1f55b882a3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553e9ae19c324947b3c38d3a5ea45ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:37Z,use_quota=True,user_id='2e7bbed3055d41d5852e703880b7d640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Creating volume 72c2168a-192b-41b9-baab-1f55b882a3c6 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:43 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-72c2168a-192b-41b9-baab-1f55b882a3c6 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bb3155-98db-459b-b437-d881febf7430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:43 devstack sudo[104692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-72c2168a-192b-41b9-baab-1f55b882a3c6 1073741824
Jul 09 09:21:43 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b2fc23-3800-4e1e-94c0-f99b14f93a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:43 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Volume volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41 (67ab8ac5-7ed6-4756-b67a-c48b949fef41): created successfully
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b2fc23-3800-4e1e-94c0-f99b14f93a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Flow 'volume_create_manager' (3c45b230-6824-4bed-82a9-91bad50bad9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:43 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-ea9cc55e-5cfd-40f2-a980-74ebd0f23fa0 tempest-CreateVolumesFromImageTest-1740969168 None] Created volume successfully.
Jul 09 09:21:43 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD" returned: 1 in 0.723s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:21:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:44 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-72c2168a-192b-41b9-baab-1f55b882a3c6 1073741824" returned: 0 in 0.801s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-72c2168a-192b-41b9-baab-1f55b882a3c6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:44 devstack sudo[104701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-72c2168a-192b-41b9-baab-1f55b882a3c6
Jul 09 09:21:44 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:44 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-72c2168a-192b-41b9-baab-1f55b882a3c6" returned: 0 in 0.637s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.766s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1695346289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d644a66-3c16-4926-aa0e-bfa1d6537443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553e9ae19c324947b3c38d3a5ea45ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:38Z,use_quota=True,user_id='2e7bbed3055d41d5852e703880b7d640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Creating volume 4d644a66-3c16-4926-aa0e-bfa1d6537443 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:44 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d644a66-3c16-4926-aa0e-bfa1d6537443 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:44 devstack sudo[104704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d644a66-3c16-4926-aa0e-bfa1d6537443 1073741824
Jul 09 09:21:44 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8739dffb-4865-4f0c-95f5-9d0fbb9b448b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c2168a-192b-41b9-baab-1f55b882a3c6', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d6b990b-2069-4baf-8c27-dd8c64df7287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:44 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Volume volume-72c2168a-192b-41b9-baab-1f55b882a3c6 (72c2168a-192b-41b9-baab-1f55b882a3c6): created successfully
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d6b990b-2069-4baf-8c27-dd8c64df7287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:44 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Flow 'volume_create_manager' (f30ec101-3d44-40e4-a51b-71dbe5c43460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:44 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-37b3a935-7072-4733-9330-207d1707e541 tempest-CreateVolumesFromImageTest-1740969168 None] Created volume successfully.
Jul 09 09:21:45 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d644a66-3c16-4926-aa0e-bfa1d6537443 1073741824" returned: 0 in 0.802s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d644a66-3c16-4926-aa0e-bfa1d6537443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:45 devstack sudo[104709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d644a66-3c16-4926-aa0e-bfa1d6537443
Jul 09 09:21:45 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:46 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d644a66-3c16-4926-aa0e-bfa1d6537443" returned: 0 in 0.637s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.749s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] Creating offline snapshot cd429247-9510-4835-a543-c2c83adaaec8 of volume 73da80d0-a3ee-4e6c-88fe-f9c360970a87 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e305b51e-209e-469a-aac5-db4aa5ca5872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d644a66-3c16-4926-aa0e-bfa1d6537443', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c739ba-802f-4e99-86b5-1396d2b5a1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad508073-c5eb-44de-a6c8-19b2b832d0b5]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:46 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Volume volume-4d644a66-3c16-4926-aa0e-bfa1d6537443 (4d644a66-3c16-4926-aa0e-bfa1d6537443): created successfully
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c739ba-802f-4e99-86b5-1396d2b5a1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Flow 'volume_create_manager' (c44866d8-b360-4e22-a943-c85bfc68a079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:46 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-cfc1ffe1-8356-4632-9aaf-f1338c819209 tempest-CreateVolumesFromImageTest-1740969168 None] Created volume successfully.
Jul 09 09:21:46 devstack sudo[104712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87
Jul 09 09:21:46 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "cinder-4d644a66-3c16-4926-aa0e-bfa1d6537443-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-4d644a66-3c16-4926-aa0e-bfa1d6537443-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "cinder-quobyte-4d644a66-3c16-4926-aa0e-bfa1d6537443" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-quobyte-4d644a66-3c16-4926-aa0e-bfa1d6537443" acquired by "delete_volume" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd53ae17-99b8-499c-bc87-b3d84ffafd20]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d644a66-3c16-4926-aa0e-bfa1d6537443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:47 devstack sudo[104714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d644a66-3c16-4926-aa0e-bfa1d6537443
Jul 09 09:21:47 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:47 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87" returned: 0 in 0.754s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:47 devstack sudo[104719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8 1G
Jul 09 09:21:47 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:47 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d644a66-3c16-4926-aa0e-bfa1d6537443" returned: 0 in 0.771s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d644a66-3c16-4926-aa0e-bfa1d6537443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:47 devstack sudo[104727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d644a66-3c16-4926-aa0e-bfa1d6537443
Jul 09 09:21:47 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:47 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8 1G" returned: 0 in 0.805s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:47 devstack sudo[104729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8
Jul 09 09:21:47 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:48 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4d644a66-3c16-4926-aa0e-bfa1d6537443" returned: 0 in 0.630s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:48 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-quobyte-4d644a66-3c16-4926-aa0e-bfa1d6537443" released by "delete_volume" :: held 1.445s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:48 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Created reservations ['dccda557-eca7-405d-91b8-42e2d80504f1', '920c8dc9-9115-458b-801d-9f2260a5fb3f', '83e8b16d-0bf5-4750-ad95-97be40fa8af5', 'b00ec241-4416-4164-9f6e-2dc26d15fabc'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:21:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:48 devstack sudo[104735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:21:48 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:48 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8" returned: 0 in 0.716s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:48 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8 is being set with open permissions: ugo+rw
Jul 09 09:21:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:48 devstack sudo[104737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8
Jul 09 09:21:48 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:49 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "cinder-72c2168a-192b-41b9-baab-1f55b882a3c6-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:49 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-72c2168a-192b-41b9-baab-1f55b882a3c6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:49 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "cinder-quobyte-72c2168a-192b-41b9-baab-1f55b882a3c6" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:49 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.703s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:49 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:21:49 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Deleted volume successfully.
Jul 09 09:21:49 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-quobyte-72c2168a-192b-41b9-baab-1f55b882a3c6" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:49 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0dc1ec4d-554e-4fbf-b72e-715a03cb7524 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-4d644a66-3c16-4926-aa0e-bfa1d6537443-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:49 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[452d16a5-004b-4db9-848e-d78a76da69aa]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-72c2168a-192b-41b9-baab-1f55b882a3c6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:49 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8" returned: 0 in 0.679s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:49 devstack sudo[104743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.info
Jul 09 09:21:49 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:49 devstack sudo[104741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-72c2168a-192b-41b9-baab-1f55b882a3c6
Jul 09 09:21:49 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:50 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.info" returned: 0 in 0.659s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:50 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.info is being set with open permissions: ugo+rw
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:50 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:50 devstack sudo[104750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.info
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-72c2168a-192b-41b9-baab-1f55b882a3c6" returned: 0 in 0.765s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:50 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-72c2168a-192b-41b9-baab-1f55b882a3c6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:50 devstack sudo[104752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-72c2168a-192b-41b9-baab-1f55b882a3c6
Jul 09 09:21:50 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:50 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.info" returned: 0 in 0.658s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:50 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.364s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.864s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942294c4-24e5-4f47-ba91-791b9418bb6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2492942e07049b0b0d467829b2e6ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:39Z,use_quota=True,user_id='0d8bbda529104582bb5d6f33cbab4ae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Creating volume 942294c4-24e5-4f47-ba91-791b9418bb6c {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:50 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-72c2168a-192b-41b9-baab-1f55b882a3c6" returned: 0 in 0.675s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:50 devstack sudo[104756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c 1073741824
Jul 09 09:21:50 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-quobyte-72c2168a-192b-41b9-baab-1f55b882a3c6" released by "delete_volume" :: held 1.500s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:50 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-fd9c8521-6ef2-4462-bc12-d2bf9ac7f93d tempest-CreateVolumesFromSnapshotTest-1909182194 None] Create snapshot completed successfully
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Created reservations ['46bba23e-0949-4be5-b6b2-22bf85f3636c', 'f469bb97-4b3a-4f7d-960d-3f1e2b433ec3', 'de0f3ac5-9502-495b-be8c-ce192aa65783', '2a6017b7-dec0-4795-9f5d-0fefd9deebab'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:50 devstack sudo[104758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:21:50 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "cinder-67ab8ac5-7ed6-4756-b67a-c48b949fef41-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-67ab8ac5-7ed6-4756-b67a-c48b949fef41-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Flow 'volume_create_manager' (8500256e-90e6-4779-b0da-18bebf40273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (888e6094-bc5f-40b4-b9bf-d075a9fa2f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (888e6094-bc5f-40b4-b9bf-d075a9fa2f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-853559293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e78e864b-2672-4b2f-9779-c00342b82cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec985cc5b3243d1961285ae8ef52c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:51Z,use_quota=True,user_id='f208bcb64ca14acfa871102f2f62cfa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a820d08-0d55-464f-a90b-1453d0de2e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a820d08-0d55-464f-a90b-1453d0de2e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321b69a7-41a0-49f7-90e2-b62e8db77d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321b69a7-41a0-49f7-90e2-b62e8db77d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e78e864b-2672-4b2f-9779-c00342b82cb7', 'volume_name': 'volume-e78e864b-2672-4b2f-9779-c00342b82cb7', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfa80e7-c7f4-45a5-9cfe-34c1f9aa6707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfa80e7-c7f4-45a5-9cfe-34c1f9aa6707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c7ba25-9f71-43d0-b29e-358e2138ec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:51 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume e78e864b-2672-4b2f-9779-c00342b82cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e78e864b-2672-4b2f-9779-c00342b82cb7', 'volume_size': 1}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "cinder-quobyte-67ab8ac5-7ed6-4756-b67a-c48b949fef41" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-quobyte-67ab8ac5-7ed6-4756-b67a-c48b949fef41" acquired by "delete_volume" :: waited 0.030s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55fa9be-7bb0-4ed2-ba70-377fab1a7036]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:51 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.814s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:21:51 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Deleted volume successfully.
Jul 09 09:21:51 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c 1073741824" returned: 0 in 1.045s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fa4f090a-690b-4092-8850-79fe677844a3 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-72c2168a-192b-41b9-baab-1f55b882a3c6-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:51 devstack sudo[104765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41
Jul 09 09:21:51 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:51 devstack sudo[104767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c
Jul 09 09:21:51 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:51 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Flow 'volume_create_manager' (bfad3956-ab35-4d7b-b0fd-8c7d79506d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d362d4a-b194-4b8c-b8f8-1b64a0f1da56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d362d4a-b194-4b8c-b8f8-1b64a0f1da56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182094932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afadaf4-1598-472c-974f-51e26161b004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec985cc5b3243d1961285ae8ef52c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:52Z,use_quota=True,user_id='f208bcb64ca14acfa871102f2f62cfa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fdd24e-4ef0-4275-b2c0-f27fa803edce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fdd24e-4ef0-4275-b2c0-f27fa803edce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df0c15f-1560-4ffb-9696-c1743da2e0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df0c15f-1560-4ffb-9696-c1743da2e0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2afadaf4-1598-472c-974f-51e26161b004', 'volume_name': 'volume-2afadaf4-1598-472c-974f-51e26161b004', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5747bc63-4b5e-4a92-be75-ad2d39c70173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5747bc63-4b5e-4a92-be75-ad2d39c70173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9808ab46-3977-407d-b33d-05340948c9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume 2afadaf4-1598-472c-974f-51e26161b004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2afadaf4-1598-472c-974f-51e26161b004', 'volume_size': 1}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Flow 'volume_create_manager' (f11fa87e-1b6a-4df1-881c-66f247c158b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62840f2b-9c2a-4074-af86-6eaa1b70f332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62840f2b-9c2a-4074-af86-6eaa1b70f332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1451201216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9088b367-47b4-4f0f-bce2-662d8501e227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec985cc5b3243d1961285ae8ef52c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:52Z,use_quota=True,user_id='f208bcb64ca14acfa871102f2f62cfa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2aeeaad-2132-46f5-93f4-666561a96e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2aeeaad-2132-46f5-93f4-666561a96e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bff0e34-5aa6-495a-8f21-cc2d0adc4d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bff0e34-5aa6-495a-8f21-cc2d0adc4d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9088b367-47b4-4f0f-bce2-662d8501e227', 'volume_name': 'volume-9088b367-47b4-4f0f-bce2-662d8501e227', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179f5e74-fd01-4c0d-a20b-6e7ce0b840ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179f5e74-fd01-4c0d-a20b-6e7ce0b840ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd240d9-da24-4130-82c8-f56bac83bbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume 9088b367-47b4-4f0f-bce2-662d8501e227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9088b367-47b4-4f0f-bce2-662d8501e227', 'volume_size': 1}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:52 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41" returned: 0 in 0.980s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:52 devstack sudo[104773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41
Jul 09 09:21:52 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Flow 'volume_create_manager' (e4cd68f0-94cd-4add-bd58-782db0ab0221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64570bcc-8946-4f22-924e-0c43cc10e5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c" returned: 0 in 0.923s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.834s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=447ddc11-b593-40c6-95fa-c2325015a76d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f5192bf9c745fea94de93035307fb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:40Z,use_quota=True,user_id='54e9f5ab6fe84f758279473749f14a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f415c8f1-0915-4f09-9c9d-afa1f92eaff8),volume_type_id=f415c8f1-0915-4f09-9c9d-afa1f92eaff8)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Creating volume 447ddc11-b593-40c6-95fa-c2325015a76d {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:52 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64570bcc-8946-4f22-924e-0c43cc10e5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-428748896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2069f825-d095-4a35-9e05-e0f4dcf7222d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec985cc5b3243d1961285ae8ef52c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:53Z,use_quota=True,user_id='f208bcb64ca14acfa871102f2f62cfa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cb6b96-ec18-4633-9f25-8ed2db3ae305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cb6b96-ec18-4633-9f25-8ed2db3ae305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:52 devstack sudo[104775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d 1073741824
Jul 09 09:21:52 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87620201-1b07-4e3d-933b-0fe9ef2ded7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87620201-1b07-4e3d-933b-0fe9ef2ded7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2069f825-d095-4a35-9e05-e0f4dcf7222d', 'volume_name': 'volume-2069f825-d095-4a35-9e05-e0f4dcf7222d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18aa281-f401-493a-a875-518aa34114ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18aa281-f401-493a-a875-518aa34114ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7acc327-247e-41f6-9a50-7f16176a122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:52 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume 2069f825-d095-4a35-9e05-e0f4dcf7222d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2069f825-d095-4a35-9e05-e0f4dcf7222d', 'volume_size': 1}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Attempting download of ff324b0a-a641-4371-9273-9ad9642518e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ff324b0a-a641-4371-9273-9ad9642518e2', 'metadata': {}}])) to volume 942294c4-24e5-4f47-ba91-791b9418bb6c. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c942aaf6-ac01-47ba-b4a7-6e7326927d72]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff324b0a-a641-4371-9273-9ad9642518e2_hs6i_p5u {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:53 devstack sudo[104777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff324b0a-a641-4371-9273-9ad9642518e2_hs6i_p5u
Jul 09 09:21:53 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Flow 'volume_create_manager' (738ec532-b3f0-4cce-966a-481c6aa531e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24806cc0-db80-4c36-955d-ff3147b5ea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24806cc0-db80-4c36-955d-ff3147b5ea28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1052606233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10725636-c0ac-4b82-a068-fe9d44cd2cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec985cc5b3243d1961285ae8ef52c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:53Z,use_quota=True,user_id='f208bcb64ca14acfa871102f2f62cfa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af4e167-e777-406a-a2b4-ce224bd52437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af4e167-e777-406a-a2b4-ce224bd52437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecb765a-f128-42df-99c9-2c4b28654615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecb765a-f128-42df-99c9-2c4b28654615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10725636-c0ac-4b82-a068-fe9d44cd2cd3', 'volume_name': 'volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d793b3f-ad6f-40d1-8cc8-1c5913e99d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d793b3f-ad6f-40d1-8cc8-1c5913e99d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19f3512-ff38-4907-a953-e312b08cdf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:53 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume 10725636-c0ac-4b82-a068-fe9d44cd2cd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3', 'volume_size': 1}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:53 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-67ab8ac5-7ed6-4756-b67a-c48b949fef41" returned: 0 in 0.820s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-quobyte-67ab8ac5-7ed6-4756-b67a-c48b949fef41" released by "delete_volume" :: held 1.878s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Created reservations ['f35cfaf6-df66-48ee-a4ca-018a1d060f9c', 'f6234e86-d21b-441b-98f9-dc01bf4b151d', 'b5669d1c-08af-4edb-8a8e-14a596ff2f52', '0213792b-9806-4ece-80c0-601690c6de59'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:53 devstack sudo[104788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:21:53 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "cinder-dac7df44-bc3f-4796-8702-ff4a3b97133b-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-dac7df44-bc3f-4796-8702-ff4a3b97133b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:53 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d 1073741824" returned: 0 in 0.983s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:53 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff324b0a-a641-4371-9273-9ad9642518e2_hs6i_p5u" returned: 0 in 0.858s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff324b0a-a641-4371-9273-9ad9642518e2_hs6i_p5u {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "cinder-quobyte-dac7df44-bc3f-4796-8702-ff4a3b97133b" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-quobyte-dac7df44-bc3f-4796-8702-ff4a3b97133b" acquired by "delete_volume" :: waited 0.040s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:53 devstack sudo[104791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d
Jul 09 09:21:53 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d04523-7ea7-40ff-8854-a3437e094b3b]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dac7df44-bc3f-4796-8702-ff4a3b97133b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:53 devstack sudo[104790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff324b0a-a641-4371-9273-9ad9642518e2_hs6i_p5u
Jul 09 09:21:53 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:53 devstack sudo[104793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dac7df44-bc3f-4796-8702-ff4a3b97133b
Jul 09 09:21:53 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:54 devstack sudo[104796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:21:54 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:54 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff324b0a-a641-4371-9273-9ad9642518e2_hs6i_p5u" returned: 1 in 0.885s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff324b0a-a641-4371-9273-9ad9642518e2_hs6i_p5u' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c12e5c2-f803-4694-a479-84d72917b5a8]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:54 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.041s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:21:54 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:54 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Deleted volume successfully.
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d" returned: 0 in 0.918s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.156s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-853559293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e78e864b-2672-4b2f-9779-c00342b82cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec985cc5b3243d1961285ae8ef52c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:51Z,use_quota=True,user_id='f208bcb64ca14acfa871102f2f62cfa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Creating volume e78e864b-2672-4b2f-9779-c00342b82cb7 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:54 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e78e864b-2672-4b2f-9779-c00342b82cb7 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:54 devstack sudo[104806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e78e864b-2672-4b2f-9779-c00342b82cb7 1073741824
Jul 09 09:21:54 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-58fa3287-75a0-45d9-bdd2-9a1b54dd9a26 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-67ab8ac5-7ed6-4756-b67a-c48b949fef41-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Attempting download of 2de410a6-8e05-448a-ab40-dfdb26eaa1ca ((None, [{'url': 'file:///opt/stack/data/glance/images/2de410a6-8e05-448a-ab40-dfdb26eaa1ca', 'metadata': {}}])) to volume 447ddc11-b593-40c6-95fa-c2325015a76d. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 09 09:21:54 devstack sudo[104802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD
Jul 09 09:21:54 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:54 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dac7df44-bc3f-4796-8702-ff4a3b97133b" returned: 0 in 1.031s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dac7df44-bc3f-4796-8702-ff4a3b97133b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a962f27-5b31-4e11-beab-e5260bc7627e]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_qvicm5c8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:54 devstack sudo[104809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dac7df44-bc3f-4796-8702-ff4a3b97133b
Jul 09 09:21:54 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:55 devstack sudo[104810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_qvicm5c8
Jul 09 09:21:55 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:55 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.063s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:21:55 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:55 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-dac7df44-bc3f-4796-8702-ff4a3b97133b" returned: 0 in 0.751s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD" returned: 0 in 0.997s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-quobyte-dac7df44-bc3f-4796-8702-ff4a3b97133b" released by "delete_volume" :: held 1.849s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Created reservations ['d0e604be-d05b-4300-bcc8-7c884d6c069c', 'ef5354d2-5f2d-4bf8-a6aa-04720ff365ae', 'b7e71689-d073-48f5-a3d5-b9b9e32e9629', '5d498758-6926-4933-b80b-b1a41db5be08'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:21:55 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_qvicm5c8" returned: 0 in 0.861s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_qvicm5c8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:55 devstack sudo[104823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD
Jul 09 09:21:55 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:55 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e78e864b-2672-4b2f-9779-c00342b82cb7 1073741824" returned: 0 in 1.085s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e78e864b-2672-4b2f-9779-c00342b82cb7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:55 devstack sudo[104826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:21:55 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:55 devstack sudo[104827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e78e864b-2672-4b2f-9779-c00342b82cb7
Jul 09 09:21:55 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:55 devstack sudo[104825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_qvicm5c8
Jul 09 09:21:55 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "cinder-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "cinder-quobyte-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-quobyte-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7" acquired by "delete_volume" :: waited 0.029s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[860ef4d2-28a6-4df5-897c-dce9c99b77c1]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:56 devstack sudo[104831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7
Jul 09 09:21:56 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:56 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD" returned: 1 in 1.066s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] ff324b0a-a641-4371-9273-9ad9642518e2 was raw, converting to raw {{(pid=87009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:56 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e78e864b-2672-4b2f-9779-c00342b82cb7" returned: 0 in 0.880s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.647s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182094932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afadaf4-1598-472c-974f-51e26161b004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec985cc5b3243d1961285ae8ef52c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:52Z,use_quota=True,user_id='f208bcb64ca14acfa871102f2f62cfa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:56 devstack sudo[104838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c
Jul 09 09:21:56 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Creating volume 2afadaf4-1598-472c-974f-51e26161b004 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:56 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2afadaf4-1598-472c-974f-51e26161b004 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c7ba25-9f71-43d0-b29e-358e2138ec24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e78e864b-2672-4b2f-9779-c00342b82cb7', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:56 devstack sudo[104840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2afadaf4-1598-472c-974f-51e26161b004 1073741824
Jul 09 09:21:56 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388aebe5-4609-46a4-ad2e-642a95ad8435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:56 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume volume-e78e864b-2672-4b2f-9779-c00342b82cb7 (e78e864b-2672-4b2f-9779-c00342b82cb7): created successfully
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388aebe5-4609-46a4-ad2e-642a95ad8435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Flow 'volume_create_manager' (8500256e-90e6-4779-b0da-18bebf40273c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:56 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-83d2ffae-0515-4bc2-9761-6c6ef09835b2 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Created volume successfully.
Jul 09 09:21:56 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.109s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:21:56 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:56 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Deleted volume successfully.
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_qvicm5c8" returned: 1 in 1.190s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_qvicm5c8' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7572a8b9-e5b5-48fd-bbe8-77b7273003cb]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb3f004e-3321-4516-a9c3-3c9bfa80e5e0 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-dac7df44-bc3f-4796-8702-ff4a3b97133b-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:57 devstack sudo[104844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD
Jul 09 09:21:57 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:57 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7" returned: 0 in 1.005s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:57 devstack sudo[104849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7
Jul 09 09:21:57 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:57 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c" returned: 0 in 0.980s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:57 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ff324b0a-a641-4371-9273-9ad9642518e2_rqyc74_ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:21:57 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Converted 0.00 MB image at 0.00 MB/s
Jul 09 09:21:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:57 devstack sudo[104857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c 1G
Jul 09 09:21:57 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:57 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2afadaf4-1598-472c-974f-51e26161b004 1073741824" returned: 0 in 1.115s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2afadaf4-1598-472c-974f-51e26161b004 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:57 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD" returned: 0 in 0.967s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:57 devstack sudo[104863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2afadaf4-1598-472c-974f-51e26161b004
Jul 09 09:21:57 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:57 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7" returned: 0 in 0.723s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-quobyte-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7" released by "delete_volume" :: held 1.782s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Created reservations ['f1da0712-e0af-414d-9964-5d31b00b32e5', 'e078241a-f29f-459a-a0c2-bc853e101b9c', 'e7db3997-81bf-4bb3-9e8a-c7ced5bb424b', '1a71519d-e48b-4fbb-a888-7b4dc1b5b9c0'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:21:58 devstack sudo[104864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD
Jul 09 09:21:58 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:58 devstack sudo[104867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:21:58 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:58 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c 1G" returned: 0 in 0.952s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae790fc1-cc20-4f80-b3ec-30b65544b29f]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:58 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2afadaf4-1598-472c-974f-51e26161b004" returned: 0 in 0.855s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.423s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1451201216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9088b367-47b4-4f0f-bce2-662d8501e227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec985cc5b3243d1961285ae8ef52c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:52Z,use_quota=True,user_id='f208bcb64ca14acfa871102f2f62cfa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Creating volume 9088b367-47b4-4f0f-bce2-662d8501e227 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:21:58 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9088b367-47b4-4f0f-bce2-662d8501e227 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:58 devstack sudo[104875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9088b367-47b4-4f0f-bce2-662d8501e227 1073741824
Jul 09 09:21:58 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9808ab46-3977-407d-b33d-05340948c9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2afadaf4-1598-472c-974f-51e26161b004', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:58 devstack sudo[104873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c
Jul 09 09:21:58 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77360e35-c0e8-4343-bfde-ceaae4856875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:21:58 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume volume-2afadaf4-1598-472c-974f-51e26161b004 (2afadaf4-1598-472c-974f-51e26161b004): created successfully
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77360e35-c0e8-4343-bfde-ceaae4856875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Flow 'volume_create_manager' (bfad3956-ab35-4d7b-b0fd-8c7d79506d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:21:58 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-434456ea-56ae-4eeb-929e-4b66ac3a6298 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Created volume successfully.
Jul 09 09:21:58 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.815s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:58 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:21:59 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Deleted volume successfully.
Jul 09 09:21:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7e280d5-15ea-45c0-b0ee-07741c1771c3 tempest-CreateVolumesFromImageTest-1740969168 None] Lock "cinder-2d2ee183-3cca-4a06-8f42-6b7e1f8e04d7-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:21:59 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD" returned: 1 in 1.130s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:21:59 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] 2de410a6-8e05-448a-ab40-dfdb26eaa1ca was raw, converting to raw {{(pid=87009) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 09 09:21:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:59 devstack sudo[104881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d
Jul 09 09:21:59 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:59 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c" returned: 0 in 0.970s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:21:59 devstack sudo[104889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c
Jul 09 09:21:59 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:21:59 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root
Jul 09 09:21:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d" returned: 0 in 0.891s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:21:59 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2de410a6-8e05-448a-ab40-dfdb26eaa1ca_3n1_18mudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:21:59 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Converted 0.00 MB image at 0.00 MB/s
Jul 09 09:21:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:00 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9088b367-47b4-4f0f-bce2-662d8501e227 1073741824" returned: 0 in 1.191s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:00 devstack sudo[104894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d 1G
Jul 09 09:22:00 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9088b367-47b4-4f0f-bce2-662d8501e227 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:00 devstack sudo[104896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9088b367-47b4-4f0f-bce2-662d8501e227
Jul 09 09:22:00 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:00 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c" returned: 1 in 0.896s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Downloaded image ff324b0a-a641-4371-9273-9ad9642518e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ff324b0a-a641-4371-9273-9ad9642518e2', 'metadata': {}}])) to volume 942294c4-24e5-4f47-ba91-791b9418bb6c successfully. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Temporary image ff324b0a-a641-4371-9273-9ad9642518e2 for user 0d8bbda529104582bb5d6f33cbab4ae7 is deleted. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Marking volume 942294c4-24e5-4f47-ba91-791b9418bb6c as bootable. {{(pid=87009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Copying metadata from image ff324b0a-a641-4371-9273-9ad9642518e2 to 942294c4-24e5-4f47-ba91-791b9418bb6c. {{(pid=87009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Creating volume glance metadata for volume 942294c4-24e5-4f47-ba91-791b9418bb6c backed by image ff324b0a-a641-4371-9273-9ad9642518e2 with: {'image_id': 'ff324b0a-a641-4371-9273-9ad9642518e2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '95c29381916c3f6ead5adca7d3e683f1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85826a1d-12e5-402a-9b80-494f77dca45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942294c4-24e5-4f47-ba91-791b9418bb6c', 'volume_size': 1, 'image_id': 'ff324b0a-a641-4371-9273-9ad9642518e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff324b0a-a641-4371-9273-9ad9642518e2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '95c29381916c3f6ead5adca7d3e683f1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2492942e07049b0b0d467829b2e6ee7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e93d13f7b1be5eebb6e34575cf15c75976a5ee6d9ce546eecfb342c45d76299cfdf933b2f0b033ba65f444a830909137c1cf4b16f8a1bb942013c0c32683986a', 'id': 'ff324b0a-a641-4371-9273-9ad9642518e2', 'created_at': datetime.datetime(2026, 7, 9, 7, 21, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 21, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff324b0a-a641-4371-9273-9ad9642518e2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a6e3290>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c087b4-8c93-4d0b-8b17-836541c28dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:00 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Volume volume-942294c4-24e5-4f47-ba91-791b9418bb6c (942294c4-24e5-4f47-ba91-791b9418bb6c): created successfully
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c087b4-8c93-4d0b-8b17-836541c28dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Flow 'volume_create_manager' (6a49ef4a-5d84-4bcd-b082-905a128ddd43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:00 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2428ca26-2ef5-4e05-8e62-7f7d710ff145 tempest-VolumeImageDependencyTests-37197695 None] Created volume successfully.
Jul 09 09:22:00 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9088b367-47b4-4f0f-bce2-662d8501e227" returned: 0 in 0.855s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] <== create_volume: return (2104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.098s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-428748896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2069f825-d095-4a35-9e05-e0f4dcf7222d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec985cc5b3243d1961285ae8ef52c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:53Z,use_quota=True,user_id='f208bcb64ca14acfa871102f2f62cfa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Creating volume 2069f825-d095-4a35-9e05-e0f4dcf7222d {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:00 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2069f825-d095-4a35-9e05-e0f4dcf7222d 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:00 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d 1G" returned: 0 in 0.973s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd240d9-da24-4130-82c8-f56bac83bbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9088b367-47b4-4f0f-bce2-662d8501e227', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:00 devstack sudo[104906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2069f825-d095-4a35-9e05-e0f4dcf7222d 1073741824
Jul 09 09:22:00 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821015f3-e332-4b08-8b5b-43e5efe38219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:00 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume volume-9088b367-47b4-4f0f-bce2-662d8501e227 (9088b367-47b4-4f0f-bce2-662d8501e227): created successfully
Jul 09 09:22:00 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821015f3-e332-4b08-8b5b-43e5efe38219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:01 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Flow 'volume_create_manager' (f11fa87e-1b6a-4df1-881c-66f247c158b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:01 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b61554d-d229-46db-b37d-a8983329891d]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:01 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b79d132a-f2f3-4302-94b8-2ec86039fb27 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Created volume successfully.
Jul 09 09:22:01 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d
Jul 09 09:22:01 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Acquiring lock "cinder-942294c4-24e5-4f47-ba91-791b9418bb6c-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Lock "cinder-942294c4-24e5-4f47-ba91-791b9418bb6c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Acquiring lock "cinder-quobyte-942294c4-24e5-4f47-ba91-791b9418bb6c" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Lock "cinder-quobyte-942294c4-24e5-4f47-ba91-791b9418bb6c" acquired by "delete_volume" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:01 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a686e98c-b6b8-4638-8c55-bdf74d52463b]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:01 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2069f825-d095-4a35-9e05-e0f4dcf7222d 1073741824" returned: 0 in 0.990s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:01 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d" returned: 0 in 0.930s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2069f825-d095-4a35-9e05-e0f4dcf7222d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:02 devstack sudo[104916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c
Jul 09 09:22:02 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:02 devstack sudo[104918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2069f825-d095-4a35-9e05-e0f4dcf7222d
Jul 09 09:22:02 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:02 devstack sudo[104917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d
Jul 09 09:22:02 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:02 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2069f825-d095-4a35-9e05-e0f4dcf7222d" returned: 0 in 0.759s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.436s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1052606233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10725636-c0ac-4b82-a068-fe9d44cd2cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec985cc5b3243d1961285ae8ef52c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:21:53Z,use_quota=True,user_id='f208bcb64ca14acfa871102f2f62cfa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Creating volume 10725636-c0ac-4b82-a068-fe9d44cd2cd3 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:02 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7acc327-247e-41f6-9a50-7f16176a122a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2069f825-d095-4a35-9e05-e0f4dcf7222d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:02 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:02 devstack sudo[104928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3 1073741824
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3334db-8bdd-4123-a0a5-f4a305d78288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:02 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c" returned: 0 in 0.992s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:02 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume volume-2069f825-d095-4a35-9e05-e0f4dcf7222d (2069f825-d095-4a35-9e05-e0f4dcf7222d): created successfully
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3334db-8bdd-4123-a0a5-f4a305d78288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Flow 'volume_create_manager' (e4cd68f0-94cd-4add-bd58-782db0ab0221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:02 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d" returned: 1 in 0.961s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Downloaded image 2de410a6-8e05-448a-ab40-dfdb26eaa1ca ((None, [{'url': 'file:///opt/stack/data/glance/images/2de410a6-8e05-448a-ab40-dfdb26eaa1ca', 'metadata': {}}])) to volume 447ddc11-b593-40c6-95fa-c2325015a76d successfully. {{(pid=87009) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Temporary image 2de410a6-8e05-448a-ab40-dfdb26eaa1ca for user 54e9f5ab6fe84f758279473749f14a2f is deleted. {{(pid=87009) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.volume_utils [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Marking volume 447ddc11-b593-40c6-95fa-c2325015a76d as bootable. {{(pid=87009) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 09 09:22:02 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-cca4ea24-86d8-41d4-bb3d-3d7538f9aab8 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Created volume successfully.
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Copying metadata from image 2de410a6-8e05-448a-ab40-dfdb26eaa1ca to 447ddc11-b593-40c6-95fa-c2325015a76d. {{(pid=87009) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Creating volume glance metadata for volume 447ddc11-b593-40c6-95fa-c2325015a76d backed by image 2de410a6-8e05-448a-ab40-dfdb26eaa1ca with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2de410a6-8e05-448a-ab40-dfdb26eaa1ca', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e8b3afe8d8738c537345d005f4d3200b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87009) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 09 09:22:02 devstack sudo[104930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c
Jul 09 09:22:02 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b08f478-50fb-4b4e-b322-6ca3b13e12ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-447ddc11-b593-40c6-95fa-c2325015a76d', 'volume_size': 1, 'image_id': '2de410a6-8e05-448a-ab40-dfdb26eaa1ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2de410a6-8e05-448a-ab40-dfdb26eaa1ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e8b3afe8d8738c537345d005f4d3200b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '46f5192bf9c745fea94de93035307fb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b00e0dca38e021cc17848f73df2f5b637d48370e315e8c9c6e5452562f8e9b9a9f25effd82da31aacf5e28bcfd707c0b43c64e117e309dfe638e68d6f32b1cf4', 'id': '2de410a6-8e05-448a-ab40-dfdb26eaa1ca', 'created_at': datetime.datetime(2026, 7, 9, 7, 21, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 21, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2de410a6-8e05-448a-ab40-dfdb26eaa1ca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7dc59a49c1d0>}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808022be-3bb2-4213-a6f3-9c0d8df2531b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:03 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Volume volume-447ddc11-b593-40c6-95fa-c2325015a76d (447ddc11-b593-40c6-95fa-c2325015a76d): created successfully
Jul 09 09:22:03 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808022be-3bb2-4213-a6f3-9c0d8df2531b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:03 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Flow 'volume_create_manager' (48cb60ca-8b3b-4a5c-b9a3-d8241c1a3630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:03 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-258ad9fe-8382-48b5-a82d-5d609f9d90e5 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Created volume successfully.
Jul 09 09:22:03 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c" returned: 1 in 0.851s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:22:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:03 devstack sudo[104939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c
Jul 09 09:22:03 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:03 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3 1073741824" returned: 0 in 1.007s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:03 devstack sudo[104941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3
Jul 09 09:22:03 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Acquiring lock "cinder-447ddc11-b593-40c6-95fa-c2325015a76d-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Lock "cinder-447ddc11-b593-40c6-95fa-c2325015a76d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Acquiring lock "cinder-quobyte-447ddc11-b593-40c6-95fa-c2325015a76d" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Lock "cinder-quobyte-447ddc11-b593-40c6-95fa-c2325015a76d" acquired by "delete_volume" :: waited 0.033s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5f0a44-0915-469e-b44d-2fd4e88b69cf]: (4, 'raw') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:04 devstack sudo[104944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d
Jul 09 09:22:04 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:04 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-942294c4-24e5-4f47-ba91-791b9418bb6c" returned: 0 in 0.878s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Lock "cinder-quobyte-942294c4-24e5-4f47-ba91-791b9418bb6c" released by "delete_volume" :: held 2.807s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Created reservations ['22ac39b9-eda8-4b62-a325-51541929cdaa', 'eca90e8a-eccb-44a1-8bbb-089e7d888cfa', 'c9b5d921-e17d-4b36-9983-11937c642f8c', '8537fdeb-142c-4db4-b795-b575d89c2a54'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:04 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3" returned: 0 in 0.937s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19f3512-ff38-4907-a953-e312b08cdf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:04 devstack sudo[104948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:04 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50385ad1-ade3-4b22-a7c3-fe6f4e9dd945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:04 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Volume volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3 (10725636-c0ac-4b82-a068-fe9d44cd2cd3): created successfully
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50385ad1-ade3-4b22-a7c3-fe6f4e9dd945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:04 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Flow 'volume_create_manager' (738ec532-b3f0-4cce-966a-481c6aa531e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:04 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-40ed181e-2ee9-4633-a584-2b27d64e69da tempest-CreateVolumesFromSnapshotTest-1909182194 None] Created volume successfully.
Jul 09 09:22:05 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d" returned: 0 in 1.001s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:05 devstack sudo[104952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d
Jul 09 09:22:05 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:05 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.906s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:05 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:05 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Deleted volume successfully.
Jul 09 09:22:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-10725636-c0ac-4b82-a068-fe9d44cd2cd3-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f7220882-f4e7-4511-aedf-9c598451cd26 tempest-VolumeImageDependencyTests-37197695 None] Lock "cinder-942294c4-24e5-4f47-ba91-791b9418bb6c-delete_volume" released by "delete_volume" :: held 4.053s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-10725636-c0ac-4b82-a068-fe9d44cd2cd3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-quobyte-10725636-c0ac-4b82-a068-fe9d44cd2cd3" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-10725636-c0ac-4b82-a068-fe9d44cd2cd3" acquired by "delete_volume" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:05 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c4ed50-c73d-4fe6-a6b8-71068a052ea9]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:05 devstack sudo[104955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3
Jul 09 09:22:05 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:06 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d" returned: 1 in 1.077s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d' failed. Not Retrying. {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 09 09:22:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:06 devstack sudo[104960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d
Jul 09 09:22:06 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:06 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3" returned: 0 in 0.988s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:06 devstack sudo[104966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3
Jul 09 09:22:06 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:07 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-447ddc11-b593-40c6-95fa-c2325015a76d" returned: 0 in 0.924s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Lock "cinder-quobyte-447ddc11-b593-40c6-95fa-c2325015a76d" released by "delete_volume" :: held 3.107s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Created reservations ['db3bf643-6e2f-4bf9-98af-750eed8b1b6c', '6d810476-6183-4752-848e-a0e1dbec07f5', 'b7a09bb0-0c8a-44fa-8392-fc65c86b696d', 'cba2a4f1-28ab-4aa8-b529-1ae8c8f88053'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:07 devstack sudo[104970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:07 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:07 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-10725636-c0ac-4b82-a068-fe9d44cd2cd3" returned: 0 in 0.814s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-10725636-c0ac-4b82-a068-fe9d44cd2cd3" released by "delete_volume" :: held 1.851s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Created reservations ['de14721b-a507-4024-97d8-0e9dfd848d1b', '9a04781e-08dd-4871-b773-b34776b78e1c', '0359f6cd-daee-49ac-9f5b-bf83703d382a', '6378daf7-5859-4dcc-aaac-7f5adb9a7b9c'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:07 devstack sudo[104972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:07 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-2069f825-d095-4a35-9e05-e0f4dcf7222d-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-2069f825-d095-4a35-9e05-e0f4dcf7222d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-quobyte-2069f825-d095-4a35-9e05-e0f4dcf7222d" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-2069f825-d095-4a35-9e05-e0f4dcf7222d" acquired by "delete_volume" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:08 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[301851dc-2922-4ab2-bad2-e6e85438b64e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2069f825-d095-4a35-9e05-e0f4dcf7222d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:08 devstack sudo[104974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2069f825-d095-4a35-9e05-e0f4dcf7222d
Jul 09 09:22:08 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:08 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.035s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:08 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:08 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Deleted volume successfully.
Jul 09 09:22:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-79a89f78-9ccd-40fc-89e2-b22a1fbbb850 tempest-VolumeAndVolumeTypeFromImageTest-60688714 None] Lock "cinder-447ddc11-b593-40c6-95fa-c2325015a76d-delete_volume" released by "delete_volume" :: held 4.546s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:08 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.114s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:08 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:08 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Deleted volume successfully.
Jul 09 09:22:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a8d8c005-1a5b-4a68-ab56-307d873f8e7e tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-10725636-c0ac-4b82-a068-fe9d44cd2cd3-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:09 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2069f825-d095-4a35-9e05-e0f4dcf7222d" returned: 0 in 1.080s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2069f825-d095-4a35-9e05-e0f4dcf7222d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:09 devstack sudo[104981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2069f825-d095-4a35-9e05-e0f4dcf7222d
Jul 09 09:22:09 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:10 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2069f825-d095-4a35-9e05-e0f4dcf7222d" returned: 0 in 0.775s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-2069f825-d095-4a35-9e05-e0f4dcf7222d" released by "delete_volume" :: held 1.924s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Created reservations ['86708fb2-7e94-4696-9fe3-dc1633f9bfd7', 'dcfa2e96-f820-4e8e-a14c-4c00fdeba8d0', '2f2af28b-89d7-4689-bbe0-a6ee311956c7', 'e9069cec-86ad-409a-9dc4-dde09e0364a2'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:10 devstack sudo[104985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:10 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-9088b367-47b4-4f0f-bce2-662d8501e227-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-9088b367-47b4-4f0f-bce2-662d8501e227-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-quobyte-9088b367-47b4-4f0f-bce2-662d8501e227" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-9088b367-47b4-4f0f-bce2-662d8501e227" acquired by "delete_volume" :: waited 0.029s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccd5b3d-4c85-44a8-86d5-8aaccd7ed7d4]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9088b367-47b4-4f0f-bce2-662d8501e227 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:10 devstack sudo[104987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9088b367-47b4-4f0f-bce2-662d8501e227
Jul 09 09:22:10 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (4420aa7e-0b2d-4da2-b236-41b7280c8cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688b397c-26c4-4e90-9cc4-7b3b47374f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688b397c-26c4-4e90-9cc4-7b3b47374f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822020841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:11Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb6893c-9182-4860-96d8-40f45cb0312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb6893c-9182-4860-96d8-40f45cb0312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b8bc48-c268-4631-bfc1-da3a715288bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b8bc48-c268-4631-bfc1-da3a715288bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b', 'volume_name': 'volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02a16e9-181a-4e2a-8c50-38538d872bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02a16e9-181a-4e2a-8c50-38538d872bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:11 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a44fd85-fda4-476e-877c-e4c3789e8f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:11 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Volume bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b', 'volume_size': 1}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822020841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:11Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Creating volume bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:11 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.920s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:11 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Deleted volume successfully.
Jul 09 09:22:11 devstack sudo[104990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b 1073741824
Jul 09 09:22:11 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8a95fbc2-3590-4e47-8f92-4507e3b48bc5 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-2069f825-d095-4a35-9e05-e0f4dcf7222d-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:11 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9088b367-47b4-4f0f-bce2-662d8501e227" returned: 0 in 0.985s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9088b367-47b4-4f0f-bce2-662d8501e227 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:11 devstack sudo[104996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9088b367-47b4-4f0f-bce2-662d8501e227
Jul 09 09:22:11 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:12 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b 1073741824" returned: 0 in 1.046s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:12 devstack sudo[105002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b
Jul 09 09:22:12 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:12 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9088b367-47b4-4f0f-bce2-662d8501e227" returned: 0 in 0.923s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:12 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-9088b367-47b4-4f0f-bce2-662d8501e227" released by "delete_volume" :: held 1.988s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:12 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Created reservations ['e311a26e-84d6-407e-9817-3c474563d013', '17e421f2-85f0-40b4-bcfa-06d437b36f7b', 'd41262ad-2b57-41b6-b97d-0a2a8739765b', 'daa6500b-ccc6-4a23-b7e5-ed6ec464ec39'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:12 devstack sudo[105005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:12 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:13 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b" returned: 0 in 0.938s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a44fd85-fda4-476e-877c-e4c3789e8f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12971f6-ac21-477f-b6a2-3a4157a393c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:13 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Volume volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b (bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b): created successfully
Jul 09 09:22:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12971f6-ac21-477f-b6a2-3a4157a393c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:13 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (4420aa7e-0b2d-4da2-b236-41b7280c8cb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-c4e0b8f4-ce6b-4d48-9020-36aa62086805 tempest-ProjectMemberTests-1928387478 None] Created volume successfully.
Jul 09 09:22:13 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.699s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:13 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Deleted volume successfully.
Jul 09 09:22:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7bd29640-20c9-495b-82ad-32ecc16226cf tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-9088b367-47b4-4f0f-bce2-662d8501e227-delete_volume" released by "delete_volume" :: held 2.999s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Flow 'volume_create_manager' (442223f4-a379-44df-b48a-fa12c97e26f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6d1d0b-97bf-4991-b62b-f75d25c08001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-2afadaf4-1598-472c-974f-51e26161b004-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6d1d0b-97bf-4991-b62b-f75d25c08001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2074696631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6912f833-3326-4fc3-b290-587ea5ddb73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c364fc8fab854303bc6746338d2ca3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:14Z,use_quota=True,user_id='aebfd4615dd04612aed028b67f4706a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00ed498-2a66-4270-9e06-8eac9e766929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00ed498-2a66-4270-9e06-8eac9e766929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4951d0f8-e0c3-432b-90e9-ca67752932ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4951d0f8-e0c3-432b-90e9-ca67752932ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6912f833-3326-4fc3-b290-587ea5ddb73e', 'volume_name': 'volume-6912f833-3326-4fc3-b290-587ea5ddb73e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3976328-5b3f-41f3-82d7-5ec049b98353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3976328-5b3f-41f3-82d7-5ec049b98353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645a1714-73c0-4880-85f0-6df86b7af77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:14 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Volume 6912f833-3326-4fc3-b290-587ea5ddb73e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6912f833-3326-4fc3-b290-587ea5ddb73e', 'volume_size': 1}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2074696631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6912f833-3326-4fc3-b290-587ea5ddb73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c364fc8fab854303bc6746338d2ca3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:14Z,use_quota=True,user_id='aebfd4615dd04612aed028b67f4706a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Creating volume 6912f833-3326-4fc3-b290-587ea5ddb73e {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:14 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:14 devstack sudo[105009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e 1073741824
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-2afadaf4-1598-472c-974f-51e26161b004-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:14 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-quobyte-2afadaf4-1598-472c-974f-51e26161b004" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-2afadaf4-1598-472c-974f-51e26161b004" acquired by "delete_volume" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c66f13-c3ce-4194-b37b-5d5624f10f02]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2afadaf4-1598-472c-974f-51e26161b004 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:14 devstack sudo[105011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2afadaf4-1598-472c-974f-51e26161b004
Jul 09 09:22:14 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:15 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e 1073741824" returned: 0 in 0.891s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:15 devstack sudo[105022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e
Jul 09 09:22:15 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:15 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2afadaf4-1598-472c-974f-51e26161b004" returned: 0 in 0.893s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2afadaf4-1598-472c-974f-51e26161b004 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:15 devstack sudo[105024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2afadaf4-1598-472c-974f-51e26161b004
Jul 09 09:22:15 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:16 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e" returned: 0 in 0.683s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.590s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] Creating offline snapshot 886d46d1-a4ca-4cab-b4fc-34476dfb44ef of volume bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645a1714-73c0-4880-85f0-6df86b7af77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6912f833-3326-4fc3-b290-587ea5ddb73e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d70963-4204-44af-a6c1-67aef4851b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4abc00-f834-4a4b-bdc0-aca1ec6b3a3e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:16 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Volume volume-6912f833-3326-4fc3-b290-587ea5ddb73e (6912f833-3326-4fc3-b290-587ea5ddb73e): created successfully
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d70963-4204-44af-a6c1-67aef4851b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Flow 'volume_create_manager' (442223f4-a379-44df-b48a-fa12c97e26f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:16 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-fd899e90-c776-4643-91c5-391734fa7141 tempest-VolumeDependencyTests-925184987 None] Created volume successfully.
Jul 09 09:22:16 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:16 devstack sudo[105028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b
Jul 09 09:22:16 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2afadaf4-1598-472c-974f-51e26161b004" returned: 0 in 0.798s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-2afadaf4-1598-472c-974f-51e26161b004" released by "delete_volume" :: held 1.746s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Created reservations ['bd862100-a9af-4ee5-b319-78111e9c52ef', 'bb5041d4-dc66-45a4-a0a1-6c17d2d66b8c', '03b1b6d0-ba6b-4379-a3a3-e40e8e5d877d', '71ee6d71-fadd-48e9-9951-91d4a8bf9ee0'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:16 devstack sudo[105030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:16 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-e78e864b-2672-4b2f-9779-c00342b82cb7-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-e78e864b-2672-4b2f-9779-c00342b82cb7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-quobyte-e78e864b-2672-4b2f-9779-c00342b82cb7" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-e78e864b-2672-4b2f-9779-c00342b82cb7" acquired by "delete_volume" :: waited 0.029s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:17 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5185c586-33df-4176-a65a-bf9e8bee5f16]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e78e864b-2672-4b2f-9779-c00342b82cb7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:17 devstack sudo[105032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e78e864b-2672-4b2f-9779-c00342b82cb7
Jul 09 09:22:17 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:17 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b" returned: 0 in 1.116s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:17 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.822s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:17 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:17 devstack sudo[105039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef 1G
Jul 09 09:22:17 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:17 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Deleted volume successfully.
Jul 09 09:22:17 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-480849c1-efee-4b54-a960-83b780352bf6 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-2afadaf4-1598-472c-974f-51e26161b004-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:17 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e78e864b-2672-4b2f-9779-c00342b82cb7" returned: 0 in 0.865s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e78e864b-2672-4b2f-9779-c00342b82cb7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:17 devstack sudo[105045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e78e864b-2672-4b2f-9779-c00342b82cb7
Jul 09 09:22:17 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:18 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef 1G" returned: 0 in 0.879s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:18 devstack sudo[105051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef
Jul 09 09:22:18 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:18 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e78e864b-2672-4b2f-9779-c00342b82cb7" returned: 0 in 0.703s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-e78e864b-2672-4b2f-9779-c00342b82cb7" released by "delete_volume" :: held 1.643s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:18 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Created reservations ['9d97346a-465f-4132-bf54-485b3baf3343', '5c4c739c-a1d4-46c4-9a80-a18668b34509', '3bf14094-bd3a-4339-8e0d-14256f8eb7f6', '3875f21f-1269-4799-91f8-ce9597748db5'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:18 devstack sudo[105054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:18 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:18 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef" returned: 0 in 0.739s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:18 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef is being set with open permissions: ugo+rw
Jul 09 09:22:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:19 devstack sudo[105060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef
Jul 09 09:22:19 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Flow 'volume_create_manager' (2d56b449-4929-482d-9375-900106f8931d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0886038f-663a-450c-8083-d4d07de0e411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-cd429247-9510-4835-a543-c2c83adaaec8-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0886038f-663a-450c-8083-d4d07de0e411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689590316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df75fd5c-eda1-47a2-85d0-a2d737842e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b2c0d7daf94d41bdc49086bb5db80e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:19Z,use_quota=True,user_id='777add6b88244647990b2c3b864f2ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579a780a-1335-4dbb-aaa0-b241a57aab14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579a780a-1335-4dbb-aaa0-b241a57aab14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57112846-a624-4196-bd46-99fbd2e02b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57112846-a624-4196-bd46-99fbd2e02b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df75fd5c-eda1-47a2-85d0-a2d737842e72', 'volume_name': 'volume-df75fd5c-eda1-47a2-85d0-a2d737842e72', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3d3339-e575-4154-ba5b-d3876208e321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3d3339-e575-4154-ba5b-d3876208e321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5f9c29-f196-4f54-93d3-aca760f11752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:19 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Volume df75fd5c-eda1-47a2-85d0-a2d737842e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df75fd5c-eda1-47a2-85d0-a2d737842e72', 'volume_size': 1}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-cd429247-9510-4835-a543-c2c83adaaec8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-quobyte-73da80d0-a3ee-4e6c-88fe-f9c360970a87" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-73da80d0-a3ee-4e6c-88fe-f9c360970a87" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-quobyte-cd429247-9510-4835-a543-c2c83adaaec8" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-cd429247-9510-4835-a543-c2c83adaaec8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Deleting offline snapshot cd429247-9510-4835-a543-c2c83adaaec8 of volume 73da80d0-a3ee-4e6c-88fe-f9c360970a87 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] snapshot_file for this snap is: volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba6c9cf-f32c-432c-9536-962720fd9626]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:19 devstack sudo[105062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8
Jul 09 09:22:19 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:19 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.742s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:19 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Deleted volume successfully.
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a5a082eb-1b8d-4bac-857a-b9fdea7a8a90 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-e78e864b-2672-4b2f-9779-c00342b82cb7-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:19 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef" returned: 0 in 0.662s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:19 devstack sudo[105067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.info
Jul 09 09:22:19 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:20 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8" returned: 0 in 0.798s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:22:20 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[683acff9-cedd-43a3-90bc-39478fb98c2d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:20 devstack sudo[105074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87
Jul 09 09:22:20 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:20 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.info" returned: 0 in 0.670s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:20 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.info is being set with open permissions: ugo+rw
Jul 09 09:22:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:20 devstack sudo[105077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.info
Jul 09 09:22:20 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:20 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87" returned: 0 in 0.780s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:20 devstack sudo[105083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8
Jul 09 09:22:20 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:20 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.info" returned: 0 in 0.627s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.816s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.037s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] Creating offline snapshot fe9eac09-e111-4ac9-98e8-54a8d29d782b of volume 6912f833-3326-4fc3-b290-587ea5ddb73e {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:22:21 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-29aae496-bb07-41bb-8375-700e0089e7b7 tempest-ProjectMemberTests-1928387478 None] Create snapshot completed successfully
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3b5f8b-9e9c-42fc-a6d5-d8bbc4a9105c]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:21 devstack sudo[105085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e
Jul 09 09:22:21 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:21 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8" returned: 0 in 0.765s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:21 devstack sudo[105090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8
Jul 09 09:22:21 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-886d46d1-a4ca-4cab-b4fc-34476dfb44ef-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-886d46d1-a4ca-4cab-b4fc-34476dfb44ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:21 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-886d46d1-a4ca-4cab-b4fc-34476dfb44ef" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e" returned: 0 in 0.814s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-886d46d1-a4ca-4cab-b4fc-34476dfb44ef" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Deleting offline snapshot 886d46d1-a4ca-4cab-b4fc-34476dfb44ef of volume bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:22:21 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b 1G
Jul 09 09:22:21 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] snapshot_file for this snap is: volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b24bf9e-678b-4456-b077-73c41a8af8f2]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:22 devstack sudo[105097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef
Jul 09 09:22:22 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:22 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87.cd429247-9510-4835-a543-c2c83adaaec8" returned: 0 in 0.699s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-cd429247-9510-4835-a543-c2c83adaaec8" released by "_delete_snapshot" :: held 3.147s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-73da80d0-a3ee-4e6c-88fe-f9c360970a87" released by "delete_snapshot" :: held 3.181s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:22 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Created reservations ['209c8baf-528b-4f31-8e50-0daa586ebf7d', '743625ef-9d86-46d3-9b1c-ca676e941152', '1fe25df8-43bf-4538-9f0e-fe3d39cf0bf9', '49359ef0-845e-4d5d-b986-4cfc7a734bf2'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:22 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Delete snapshot completed successfully.
Jul 09 09:22:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2295416b-53bd-46a1-9957-cfd21457e931 tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-cd429247-9510-4835-a543-c2c83adaaec8-delete_snapshot" released by "delete_snapshot" :: held 3.335s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:22 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b 1G" returned: 0 in 0.874s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6912f833-3326-4fc3-b290-587ea5ddb73e -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:22 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef" returned: 0 in 0.822s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:22 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:22:22 devstack sudo[105108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6912f833-3326-4fc3-b290-587ea5ddb73e -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b
Jul 09 09:22:22 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:22 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f7754e-38ae-4c6a-8d3a-820898e0f25f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:22 devstack sudo[105110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b
Jul 09 09:22:22 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-73da80d0-a3ee-4e6c-88fe-f9c360970a87-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-73da80d0-a3ee-4e6c-88fe-f9c360970a87-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "cinder-quobyte-73da80d0-a3ee-4e6c-88fe-f9c360970a87" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:23 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-73da80d0-a3ee-4e6c-88fe-f9c360970a87" acquired by "delete_volume" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:23 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6912f833-3326-4fc3-b290-587ea5ddb73e -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b" returned: 0 in 0.757s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:23 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b is being set with open permissions: ugo+rw
Jul 09 09:22:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:23 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ba7c38-b684-4967-ad50-4739e9edf54d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:23 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b
Jul 09 09:22:23 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:23 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b" returned: 0 in 0.819s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:23 devstack sudo[105120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87
Jul 09 09:22:23 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:23 devstack sudo[105122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef
Jul 09 09:22:23 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:24 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b" returned: 0 in 0.706s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:24 devstack sudo[105134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.info
Jul 09 09:22:24 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:24 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87" returned: 0 in 0.804s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:24 devstack sudo[105136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87
Jul 09 09:22:24 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:24 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef" returned: 0 in 0.782s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:24 devstack sudo[105138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef
Jul 09 09:22:24 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:24 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.info" returned: 0 in 0.701s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:24 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.info is being set with open permissions: ugo+rw
Jul 09 09:22:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:25 devstack sudo[105143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.info
Jul 09 09:22:25 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:25 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-73da80d0-a3ee-4e6c-88fe-f9c360970a87" returned: 0 in 0.672s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-quobyte-73da80d0-a3ee-4e6c-88fe-f9c360970a87" released by "delete_volume" :: held 1.556s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:25 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b.886d46d1-a4ca-4cab-b4fc-34476dfb44ef" returned: 0 in 0.663s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Created reservations ['295e4d0b-a721-40b9-aad7-30f6b090413d', '21ac8bec-7371-4a4c-a32a-a7257aec13e5', 'a0dadea6-508a-4feb-8b43-fd63ae7ed015', '8570926d-56f0-4d43-bee6-b26f7895047f'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-886d46d1-a4ca-4cab-b4fc-34476dfb44ef" released by "_delete_snapshot" :: held 3.210s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b" released by "delete_snapshot" :: held 3.250s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:25 devstack sudo[105145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:25 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Created reservations ['205c3483-de01-4687-848e-3e756ca49ebd', 'ce4a33ee-2296-490b-80c7-7cd427c4a971', '01ba6afd-d078-442e-9f6f-c7044033af0d', 'de48a7d7-b722-47eb-8073-e2e38ec641ac'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:25 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Delete snapshot completed successfully.
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ac6abb88-777e-42a8-a496-d6f7952b3050 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-886d46d1-a4ca-4cab-b4fc-34476dfb44ef-delete_snapshot" released by "delete_snapshot" :: held 3.489s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:25 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.info" returned: 0 in 0.651s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.640s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.451s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689590316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df75fd5c-eda1-47a2-85d0-a2d737842e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b2c0d7daf94d41bdc49086bb5db80e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:19Z,use_quota=True,user_id='777add6b88244647990b2c3b864f2ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Creating volume df75fd5c-eda1-47a2-85d0-a2d737842e72 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:25 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df75fd5c-eda1-47a2-85d0-a2d737842e72 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:25 devstack sudo[105148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df75fd5c-eda1-47a2-85d0-a2d737842e72 1073741824
Jul 09 09:22:25 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:25 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-243474b9-0b34-4727-b9d8-d49ca9cf0309 tempest-VolumeDependencyTests-925184987 None] Create snapshot completed successfully
Jul 09 09:22:25 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.703s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:25 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Deleted volume successfully.
Jul 09 09:22:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-35b978a7-2c4a-46d0-bd34-cbcb02006abb tempest-CreateVolumesFromSnapshotTest-1909182194 None] Lock "cinder-73da80d0-a3ee-4e6c-88fe-f9c360970a87-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:26 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dbdf0f-4634-41f3-9ec0-236460ea72b6]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:26 devstack sudo[105165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b
Jul 09 09:22:26 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:26 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df75fd5c-eda1-47a2-85d0-a2d737842e72 1073741824" returned: 0 in 1.254s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df75fd5c-eda1-47a2-85d0-a2d737842e72 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:27 devstack sudo[105192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df75fd5c-eda1-47a2-85d0-a2d737842e72
Jul 09 09:22:27 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Flow 'volume_create_manager' (1cb18ef2-8df8-4cf9-9589-dbb7bf1c424c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8fd0e3-ad91-4d8a-be9c-d2466a481d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb8fd0e3-ad91-4d8a-be9c-d2466a481d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-822400640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0529ff00-5506-495a-acb8-84d91e732be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c364fc8fab854303bc6746338d2ca3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe9eac09-e111-4ac9-98e8-54a8d29d782b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:27Z,use_quota=True,user_id='aebfd4615dd04612aed028b67f4706a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4634a5d2-896a-47e3-bc97-7008a953e070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4634a5d2-896a-47e3-bc97-7008a953e070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa128d2-fee3-47f5-b064-49d5f6fc1ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa128d2-fee3-47f5-b064-49d5f6fc1ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0529ff00-5506-495a-acb8-84d91e732be9', 'volume_name': 'volume-0529ff00-5506-495a-acb8-84d91e732be9', 'volume_size': 1, 'snapshot_id': 'fe9eac09-e111-4ac9-98e8-54a8d29d782b'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f3c86d-daff-4041-94de-284cc1fd373e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f3c86d-daff-4041-94de-284cc1fd373e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0653951a-0dcc-402c-98bb-16187da86cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:27 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Volume 0529ff00-5506-495a-acb8-84d91e732be9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0529ff00-5506-495a-acb8-84d91e732be9', 'volume_size': 1, 'snapshot_id': 'fe9eac09-e111-4ac9-98e8-54a8d29d782b'}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:27 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b" returned: 0 in 1.184s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:27 devstack sudo[105197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b
Jul 09 09:22:27 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:27 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df75fd5c-eda1-47a2-85d0-a2d737842e72" returned: 0 in 0.819s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.137s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.593s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "cinder-quobyte-fe9eac09-e111-4ac9-98e8-54a8d29d782b-0529ff00-5506-495a-acb8-84d91e732be9" by "_create_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5f9c29-f196-4f54-93d3-aca760f11752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df75fd5c-eda1-47a2-85d0-a2d737842e72', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0034cfa5-4352-4832-ba7a-7ebb9f584575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-quobyte-fe9eac09-e111-4ac9-98e8-54a8d29d782b-0529ff00-5506-495a-acb8-84d91e732be9" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Creating volume 0529ff00-5506-495a-acb8-84d91e732be9 from snapshot fe9eac09-e111-4ac9-98e8-54a8d29d782b {{(pid=87009) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "cinder-quobyte-0529ff00-5506-495a-acb8-84d91e732be9" by "_copy_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:27 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Volume volume-df75fd5c-eda1-47a2-85d0-a2d737842e72 (df75fd5c-eda1-47a2-85d0-a2d737842e72): created successfully
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0034cfa5-4352-4832-ba7a-7ebb9f584575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Flow 'volume_create_manager' (2d56b449-4929-482d-9375-900106f8931d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-quobyte-0529ff00-5506-495a-acb8-84d91e732be9" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] snapshot: fe9eac09-e111-4ac9-98e8-54a8d29d782b, volume: 0529ff00-5506-495a-acb8-84d91e732be9,  {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:27 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-4636a5a8-ee1c-4c0c-b49d-fd3d6cda0133 tempest-ProjectReaderTests-679744096 None] Created volume successfully.
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05fb460-8403-491b-bfac-5064b600d8b2]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:28 devstack sudo[105200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b
Jul 09 09:22:28 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:28 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b" returned: 0 in 0.775s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b" released by "delete_volume" :: held 2.035s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Created reservations ['55dda9b2-6c74-4467-9e0b-f3ec6a8cca83', '95136241-74ec-48ba-9eec-b1228ec34c98', '0e9b6b1a-9d3d-4d4a-821f-6a63179fcd95', '80935d6b-2cb4-48c3-ae5f-3fbdbcee960c'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:28 devstack sudo[105203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:28 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:28 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b" returned: 0 in 0.845s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6912f833-3326-4fc3-b290-587ea5ddb73e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] will copy from snapshot at /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Creating direct copy from snapshot {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3d26b5-4355-4731-93a6-5377f7c51057]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Acquiring lock "cinder-df75fd5c-eda1-47a2-85d0-a2d737842e72-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:28 devstack sudo[105209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e
Jul 09 09:22:28 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:28 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Lock "cinder-df75fd5c-eda1-47a2-85d0-a2d737842e72-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Acquiring lock "cinder-quobyte-df75fd5c-eda1-47a2-85d0-a2d737842e72" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Lock "cinder-quobyte-df75fd5c-eda1-47a2-85d0-a2d737842e72" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[949f973f-0cf3-46ba-843c-7f62b9006372]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df75fd5c-eda1-47a2-85d0-a2d737842e72 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:29 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.834s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:29 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Deleted volume successfully.
Jul 09 09:22:29 devstack sudo[105212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df75fd5c-eda1-47a2-85d0-a2d737842e72
Jul 09 09:22:29 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-68af28ce-e63e-4e62-b7ca-c0858d24e4c0 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-bfa1e6c7-de99-4b99-90e3-2080d4ae8c6b-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Flow 'volume_create_manager' (68d7303f-0db7-4547-84dd-cd8fe9152224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6486273d-3eea-48be-9682-0d3081be1122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6486273d-3eea-48be-9682-0d3081be1122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-391233405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3c547d-373e-4f48-a640-d5365bc5b581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fae9a443ed461189490623fb08ae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:29Z,use_quota=True,user_id='dae5b8f966204555af907804d8f6102c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660b6e19-4c97-49f2-9890-1660b7177d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660b6e19-4c97-49f2-9890-1660b7177d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757530a6-891e-4a51-b92a-dfc2ee31c7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757530a6-891e-4a51-b92a-dfc2ee31c7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a3c547d-373e-4f48-a640-d5365bc5b581', 'volume_name': 'volume-6a3c547d-373e-4f48-a640-d5365bc5b581', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cc4b09-f9d2-413d-a102-3a2d8fc63545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cc4b09-f9d2-413d-a102-3a2d8fc63545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdc365c-a80f-4ef4-92e2-d92068d5505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:29 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume 6a3c547d-373e-4f48-a640-d5365bc5b581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a3c547d-373e-4f48-a640-d5365bc5b581', 'volume_size': 1}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:29 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e" returned: 0 in 1.063s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.utils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Path /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9 not found in is_blk_device check {{(pid=87009) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:29 devstack sudo[105221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9
Jul 09 09:22:29 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (a42e0d99-53ee-4f7d-81c7-dc781c9d7c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:29 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe4b41e-a8ab-45aa-b7ca-5995ad805d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df75fd5c-eda1-47a2-85d0-a2d737842e72" returned: 0 in 0.844s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df75fd5c-eda1-47a2-85d0-a2d737842e72 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:29 devstack sudo[105223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df75fd5c-eda1-47a2-85d0-a2d737842e72
Jul 09 09:22:29 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe4b41e-a8ab-45aa-b7ca-5995ad805d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229800123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18d2b33-c821-4df2-9960-ae779cdfc93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:30Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29aaf939-4efa-4b84-9d48-a98295cb4698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:29 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29aaf939-4efa-4b84-9d48-a98295cb4698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbcde7c-beb8-4e30-a8e3-a111976389af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbcde7c-beb8-4e30-a8e3-a111976389af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18d2b33-c821-4df2-9960-ae779cdfc93d', 'volume_name': 'volume-d18d2b33-c821-4df2-9960-ae779cdfc93d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344a97f8-83af-4972-93db-b64430d80967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344a97f8-83af-4972-93db-b64430d80967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cdd413d-b4e2-435e-b698-fc9d2f9ccb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:30 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Volume d18d2b33-c821-4df2-9960-ae779cdfc93d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18d2b33-c821-4df2-9960-ae779cdfc93d', 'volume_size': 1}
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:30 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-df75fd5c-eda1-47a2-85d0-a2d737842e72" returned: 0 in 0.656s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Lock "cinder-quobyte-df75fd5c-eda1-47a2-85d0-a2d737842e72" released by "delete_volume" :: held 1.551s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Created reservations ['8a948413-da23-41e9-a9df-3f790ac31f5f', '96337564-7fd5-44ca-9416-96b2909c4ce9', '490f40b3-4435-4a97-9602-5353be66247c', 'e0dac841-34c2-45fe-962b-dedd7ee5b45b'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:30 devstack sudo[105235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:30 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:32 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.495s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:32 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Deleted volume successfully.
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f4494612-c00e-40ef-bf01-98e25a0255f6 tempest-ProjectReaderTests-679744096 None] Lock "cinder-df75fd5c-eda1-47a2-85d0-a2d737842e72-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Flow 'volume_create_manager' (78d4e7b7-b263-435f-9951-a4744984a2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20aac4cf-ecaf-4709-a7b5-e40b5e897286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20aac4cf-ecaf-4709-a7b5-e40b5e897286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-670189974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b2c0d7daf94d41bdc49086bb5db80e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:32Z,use_quota=True,user_id='777add6b88244647990b2c3b864f2ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab5e1bb-58a7-4cca-9e71-6d6625af02ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab5e1bb-58a7-4cca-9e71-6d6625af02ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdac9dcd-2675-456b-b949-b6c3eee6d19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdac9dcd-2675-456b-b949-b6c3eee6d19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec', 'volume_name': 'volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e473b612-0646-457c-b11e-0b86a4579976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e473b612-0646-457c-b11e-0b86a4579976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a281dda-ccc6-4cd8-b6d1-f88090c3f45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:32 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Volume a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec', 'volume_size': 1}
Jul 09 09:22:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:34 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9" returned: 0 in 5.006s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:34 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4f92f1-5265-4010-a754-923200c665b4]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:35 devstack sudo[105245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e
Jul 09 09:22:35 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:35 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e" returned: 0 in 0.913s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:35 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Image conversion details: src /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9 {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:22:35 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Converted 1024.00 MB image at 204.53 MB/s
Jul 09 09:22:35 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9 is being set with open permissions: ugo+rw
Jul 09 09:22:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:35 devstack sudo[105250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9
Jul 09 09:22:35 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:36 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9" returned: 0 in 0.631s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-quobyte-0529ff00-5506-495a-acb8-84d91e732be9" released by "_copy_volume_from_snapshot" :: held 8.578s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-quobyte-fe9eac09-e111-4ac9-98e8-54a8d29d782b-0529ff00-5506-495a-acb8-84d91e732be9" released by "_create_volume_from_snapshot" :: held 8.630s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.669s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.070s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-391233405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3c547d-373e-4f48-a640-d5365bc5b581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fae9a443ed461189490623fb08ae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:29Z,use_quota=True,user_id='dae5b8f966204555af907804d8f6102c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Creating volume 6a3c547d-373e-4f48-a640-d5365bc5b581 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:36 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6a3c547d-373e-4f48-a640-d5365bc5b581 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=135,cinder:UPDATE=190,cinder:DELETE=18,cinder:INSERT=51 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:22:36 devstack sudo[105253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6a3c547d-373e-4f48-a640-d5365bc5b581 1073741824
Jul 09 09:22:36 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=189,cinder:SELECT=157,cinder:INSERT=55,cinder:DELETE=16 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0653951a-0dcc-402c-98bb-16187da86cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0529ff00-5506-495a-acb8-84d91e732be9', 'volume_size': 1, 'snapshot_id': 'fe9eac09-e111-4ac9-98e8-54a8d29d782b'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613652f2-4f84-4063-81ce-6f55c6b4e547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:36 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Volume volume-0529ff00-5506-495a-acb8-84d91e732be9 (0529ff00-5506-495a-acb8-84d91e732be9): created successfully
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613652f2-4f84-4063-81ce-6f55c6b4e547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:36 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Flow 'volume_create_manager' (1cb18ef2-8df8-4cf9-9589-dbb7bf1c424c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:36 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3e536016-2de7-41ae-9566-d495657399a9 tempest-VolumeDependencyTests-925184987 None] Created volume successfully.
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "cinder-fe9eac09-e111-4ac9-98e8-54a8d29d782b-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-fe9eac09-e111-4ac9-98e8-54a8d29d782b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "cinder-quobyte-6912f833-3326-4fc3-b290-587ea5ddb73e" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-quobyte-6912f833-3326-4fc3-b290-587ea5ddb73e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "cinder-quobyte-fe9eac09-e111-4ac9-98e8-54a8d29d782b" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-quobyte-fe9eac09-e111-4ac9-98e8-54a8d29d782b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Deleting offline snapshot fe9eac09-e111-4ac9-98e8-54a8d29d782b of volume 6912f833-3326-4fc3-b290-587ea5ddb73e {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] snapshot_file for this snap is: volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fe600d-1cba-4742-a5f7-2be82bab23d4]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:37 devstack sudo[105258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b
Jul 09 09:22:37 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:37 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6a3c547d-373e-4f48-a640-d5365bc5b581 1073741824" returned: 0 in 0.883s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6a3c547d-373e-4f48-a640-d5365bc5b581 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:37 devstack sudo[105261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6a3c547d-373e-4f48-a640-d5365bc5b581
Jul 09 09:22:37 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:37 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b" returned: 0 in 0.806s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6912f833-3326-4fc3-b290-587ea5ddb73e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58625d4-1c54-45b1-83a7-7c18d4b0d77e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:38 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6a3c547d-373e-4f48-a640-d5365bc5b581" returned: 0 in 0.689s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.073s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229800123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18d2b33-c821-4df2-9960-ae779cdfc93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:30Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Creating volume d18d2b33-c821-4df2-9960-ae779cdfc93d {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:38 devstack sudo[105267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e
Jul 09 09:22:38 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:38 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:38 devstack sudo[105269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d 1073741824
Jul 09 09:22:38 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdc365c-a80f-4ef4-92e2-d92068d5505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a3c547d-373e-4f48-a640-d5365bc5b581', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c438de2d-0db6-4034-ad57-5419c4777eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:38 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume volume-6a3c547d-373e-4f48-a640-d5365bc5b581 (6a3c547d-373e-4f48-a640-d5365bc5b581): created successfully
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c438de2d-0db6-4034-ad57-5419c4777eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Flow 'volume_create_manager' (68d7303f-0db7-4547-84dd-cd8fe9152224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:38 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d842f067-35d4-46b0-bab4-f8c62ee36012 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Created volume successfully.
Jul 09 09:22:38 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e" returned: 0 in 0.788s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:38 devstack sudo[105277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b
Jul 09 09:22:38 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:38 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d 1073741824" returned: 0 in 0.820s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:38 devstack sudo[105279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d
Jul 09 09:22:38 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:39 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b" returned: 0 in 0.803s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:39 devstack sudo[105287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b
Jul 09 09:22:39 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Flow 'volume_create_manager' (bbb71749-42ee-4860-960f-e7b0f4c004ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:39 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1d4eaf-eeb5-4301-9609-bdf13ab62cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d" returned: 0 in 0.705s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.993s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-670189974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b2c0d7daf94d41bdc49086bb5db80e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:32Z,use_quota=True,user_id='777add6b88244647990b2c3b864f2ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Creating volume a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:39 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1d4eaf-eeb5-4301-9609-bdf13ab62cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1080227728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fae9a443ed461189490623fb08ae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:40Z,use_quota=True,user_id='dae5b8f966204555af907804d8f6102c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bcc0c6-5f0f-4b0a-86d2-fc33b7d1a33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bcc0c6-5f0f-4b0a-86d2-fc33b7d1a33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646d1fd6-098b-494e-997d-73e60371d3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:39 devstack sudo[105289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec 1073741824
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646d1fd6-098b-494e-997d-73e60371d3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4', 'volume_name': 'volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:39 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c817538b-b152-4091-a9bd-43177cf617bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c817538b-b152-4091-a9bd-43177cf617bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1892bb1d-d651-4d8a-a0f5-2d6c45014684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:39 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4', 'volume_size': 1}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cdd413d-b4e2-435e-b698-fc9d2f9ccb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18d2b33-c821-4df2-9960-ae779cdfc93d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a42eba1-d999-451e-bbaf-8e8a3eaa57aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:39 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Volume volume-d18d2b33-c821-4df2-9960-ae779cdfc93d (d18d2b33-c821-4df2-9960-ae779cdfc93d): created successfully
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a42eba1-d999-451e-bbaf-8e8a3eaa57aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:39 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (a42e0d99-53ee-4f7d-81c7-dc781c9d7c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:39 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-4d4643c8-97e0-4187-8421-6848f8028f07 tempest-ProjectMemberTests-1928387478 None] Created volume successfully.
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Flow 'volume_create_manager' (bde72016-8b7a-4fea-8d3d-4966d0b62b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3dbbb7-a136-414a-bf48-094d0491a813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3dbbb7-a136-414a-bf48-094d0491a813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1905926916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee3c9ad-33d8-4df7-9902-569eac055b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fae9a443ed461189490623fb08ae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:40Z,use_quota=True,user_id='dae5b8f966204555af907804d8f6102c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de98add9-9c1c-4cc8-ae41-429d1d3e8604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de98add9-9c1c-4cc8-ae41-429d1d3e8604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbc37bb-5658-4979-92f7-1e37402f8a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbc37bb-5658-4979-92f7-1e37402f8a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ee3c9ad-33d8-4df7-9902-569eac055b8e', 'volume_name': 'volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281f2d27-c50d-4bd3-a92d-e7ce7865e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281f2d27-c50d-4bd3-a92d-e7ce7865e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505712e3-92c3-41d1-95c5-c27c64bdf3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume 1ee3c9ad-33d8-4df7-9902-569eac055b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e', 'volume_size': 1}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Flow 'volume_create_manager' (7565cff2-b580-4b7f-8131-1cdb138fadde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee31562-82e2-4a85-96cd-a1ca5f1469d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee31562-82e2-4a85-96cd-a1ca5f1469d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1948412932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22227f0e-289b-41ab-8de9-b0f664d36e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fae9a443ed461189490623fb08ae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:40Z,use_quota=True,user_id='dae5b8f966204555af907804d8f6102c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6629b3e7-2602-4137-931b-121d5ea747cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6629b3e7-2602-4137-931b-121d5ea747cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c7eafc-e1f1-4926-8554-6e1e6cfc61c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c7eafc-e1f1-4926-8554-6e1e6cfc61c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22227f0e-289b-41ab-8de9-b0f664d36e34', 'volume_name': 'volume-22227f0e-289b-41ab-8de9-b0f664d36e34', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eacc3c40-3b6e-4f44-90a9-8706ceb8af6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eacc3c40-3b6e-4f44-90a9-8706ceb8af6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:40 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f725bdf-7489-49f6-bd98-1e0b799357e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume 22227f0e-289b-41ab-8de9-b0f664d36e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22227f0e-289b-41ab-8de9-b0f664d36e34', 'volume_size': 1}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e.fe9eac09-e111-4ac9-98e8-54a8d29d782b" returned: 0 in 0.931s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-quobyte-fe9eac09-e111-4ac9-98e8-54a8d29d782b" released by "_delete_snapshot" :: held 3.444s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-quobyte-6912f833-3326-4fc3-b290-587ea5ddb73e" released by "delete_snapshot" :: held 3.476s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Created reservations ['a1512d12-1345-451d-96d8-094b72cd998b', 'fe041871-ca8d-4f7e-88c7-28bbcbd9c2de', '22fda903-ffe7-440b-8f5a-1641950d4f22', 'cf025527-8296-4f74-9805-c17e6babdace'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:40 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Flow 'volume_create_manager' (6ca983c4-56ff-4627-84a5-4cd779270dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f0261a-216d-46b8-96e6-588c99cddc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec 1073741824" returned: 0 in 1.248s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f0261a-216d-46b8-96e6-588c99cddc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1010589473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ca639f-77a0-48bd-a2d3-18b498609511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fae9a443ed461189490623fb08ae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:41Z,use_quota=True,user_id='dae5b8f966204555af907804d8f6102c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f147807a-8ffb-41e8-84d3-138c7c6362f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f147807a-8ffb-41e8-84d3-138c7c6362f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d4a6eb-494e-4351-aad3-af4a9f6a9137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d4a6eb-494e-4351-aad3-af4a9f6a9137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ca639f-77a0-48bd-a2d3-18b498609511', 'volume_name': 'volume-50ca639f-77a0-48bd-a2d3-18b498609511', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564432ee-720b-4614-9995-9b75f6d020c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564432ee-720b-4614-9995-9b75f6d020c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa2d41d-f8b3-4796-b367-32af917960c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:40 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume 50ca639f-77a0-48bd-a2d3-18b498609511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ca639f-77a0-48bd-a2d3-18b498609511', 'volume_size': 1}
Jul 09 09:22:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:41 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Delete snapshot completed successfully.
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-93b56b0d-8dfb-461e-b2ba-af871de5e807 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-fe9eac09-e111-4ac9-98e8-54a8d29d782b-delete_snapshot" released by "delete_snapshot" :: held 3.967s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:41 devstack sudo[105295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec
Jul 09 09:22:41 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Flow 'volume_create_manager' (cbf9ec0a-7272-4d35-8c19-799f6d88d6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a67af6e-e53b-49fc-8562-fe4b5be96e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "cinder-6912f833-3326-4fc3-b290-587ea5ddb73e-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a67af6e-e53b-49fc-8562-fe4b5be96e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-588700409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e1c6e5-dcd6-40ee-90d9-d87e0e17179d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fae9a443ed461189490623fb08ae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:41Z,use_quota=True,user_id='dae5b8f966204555af907804d8f6102c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c2da02-8825-4260-957e-f58607f91cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c2da02-8825-4260-957e-f58607f91cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53a4054-f7c0-4116-b830-4a556224ff7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53a4054-f7c0-4116-b830-4a556224ff7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46e1c6e5-dcd6-40ee-90d9-d87e0e17179d', 'volume_name': 'volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d7f151-fd39-4d50-a3f1-29d6c0ab97b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d7f151-fd39-4d50-a3f1-29d6c0ab97b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33fbe10-614d-4a48-858f-b654e5205321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:41 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume 46e1c6e5-dcd6-40ee-90d9-d87e0e17179d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d', 'volume_size': 1}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-6912f833-3326-4fc3-b290-587ea5ddb73e-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "cinder-quobyte-6912f833-3326-4fc3-b290-587ea5ddb73e" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-quobyte-6912f833-3326-4fc3-b290-587ea5ddb73e" acquired by "delete_volume" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4c5ef9-0fa2-43a9-86b9-fe7cb2c1c84a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:41 devstack sudo[105297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e
Jul 09 09:22:41 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:41 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec" returned: 0 in 0.733s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.985s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1080227728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fae9a443ed461189490623fb08ae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:40Z,use_quota=True,user_id='dae5b8f966204555af907804d8f6102c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Creating volume a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:41 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:41 devstack sudo[105300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4 1073741824
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a281dda-ccc6-4cd8-b6d1-f88090c3f45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:41 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b28ca7-d9e8-4b34-a319-6304847fda76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:41 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Volume volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec (a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec): created successfully
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b28ca7-d9e8-4b34-a319-6304847fda76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:41 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Flow 'volume_create_manager' (78d4e7b7-b263-435f-9951-a4744984a2eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:41 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-cdfa68d9-4df9-436d-9e80-7ded00d6c067 tempest-ProjectReaderTests-679744096 None] Created volume successfully.
Jul 09 09:22:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Acquiring lock "cinder-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Lock "cinder-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Acquiring lock "cinder-quobyte-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Lock "cinder-quobyte-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec" acquired by "delete_volume" :: waited 0.030s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:42 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[461e1288-3c34-46ae-a72c-c2063927793d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:42 devstack sudo[105305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec
Jul 09 09:22:42 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e" returned: 0 in 0.792s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:42 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:42 devstack sudo[105309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e
Jul 09 09:22:42 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:42 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4 1073741824" returned: 0 in 0.960s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:42 devstack sudo[105317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4
Jul 09 09:22:42 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:43 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6912f833-3326-4fc3-b290-587ea5ddb73e" returned: 0 in 0.707s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:43 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec" returned: 0 in 0.846s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-quobyte-6912f833-3326-4fc3-b290-587ea5ddb73e" released by "delete_volume" :: held 1.569s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:43 devstack sudo[105323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec
Jul 09 09:22:43 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Created reservations ['8c1e3e67-4b68-4538-a1ef-5847a3fd8922', 'd00fa6b9-19f1-4992-95ad-f955340f83fa', 'fa3345a8-090f-42b9-a93b-50992264dd81', '78e38d09-d9d6-4040-aafc-7404d4c26cff'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:43 devstack sudo[105325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:43 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:43 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4" returned: 0 in 0.729s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.274s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1905926916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee3c9ad-33d8-4df7-9902-569eac055b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fae9a443ed461189490623fb08ae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:40Z,use_quota=True,user_id='dae5b8f966204555af907804d8f6102c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Creating volume 1ee3c9ad-33d8-4df7-9902-569eac055b8e {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:43 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1892bb1d-d651-4d8a-a0f5-2d6c45014684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:43 devstack sudo[105328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e 1073741824
Jul 09 09:22:43 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20fb67f-e26e-4ea9-9fb2-0e77317036dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:43 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4 (a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4): created successfully
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20fb67f-e26e-4ea9-9fb2-0e77317036dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Flow 'volume_create_manager' (bbb71749-42ee-4860-960f-e7b0f4c004ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "cinder-0529ff00-5506-495a-acb8-84d91e732be9-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:43 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f9744e51-c694-4aad-89b0-a37b94c23cb2 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Created volume successfully.
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-0529ff00-5506-495a-acb8-84d91e732be9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "cinder-quobyte-0529ff00-5506-495a-acb8-84d91e732be9" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-quobyte-0529ff00-5506-495a-acb8-84d91e732be9" acquired by "delete_volume" :: waited 0.030s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb0f34a-f61b-4ed4-b140-84f62bbfc9b8]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:43 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec" returned: 0 in 0.758s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Lock "cinder-quobyte-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec" released by "delete_volume" :: held 1.651s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:43 devstack sudo[105331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9
Jul 09 09:22:43 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Created reservations ['c76f0595-9f02-4c13-86f6-1593d20e5c59', '916b2ead-f331-44a5-992f-eb38e5648981', '651c8879-2e26-4bc6-9327-6cc29ddf43c8', '1acc64de-1df0-488f-8045-f6f46c1e9782'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:44 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.769s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:44 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:44 devstack sudo[105334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:44 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:44 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Deleted volume successfully.
Jul 09 09:22:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-79753c96-ace2-4f74-a96a-96cbef1d91e3 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-6912f833-3326-4fc3-b290-587ea5ddb73e-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:44 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e 1073741824" returned: 0 in 1.057s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:44 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9" returned: 0 in 0.867s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:44 devstack sudo[105343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e
Jul 09 09:22:44 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:44 devstack sudo[105345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9
Jul 09 09:22:44 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:44 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.839s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:44 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:44 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Deleted volume successfully.
Jul 09 09:22:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-9f457544-546f-4036-af1d-292f644d23c4 tempest-ProjectReaderTests-679744096 None] Lock "cinder-a2ddd34a-68ec-4b76-9fc4-1b3b812f69ec-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:45 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:45 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e" returned: 0 in 0.698s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-0529ff00-5506-495a-acb8-84d91e732be9" returned: 0 in 0.676s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.835s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1948412932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22227f0e-289b-41ab-8de9-b0f664d36e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fae9a443ed461189490623fb08ae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:40Z,use_quota=True,user_id='dae5b8f966204555af907804d8f6102c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Creating volume 22227f0e-289b-41ab-8de9-b0f664d36e34 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:45 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-22227f0e-289b-41ab-8de9-b0f664d36e34 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505712e3-92c3-41d1-95c5-c27c64bdf3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6051ccf1-dfa9-4cc9-98e3-7c32e9c7a4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:45 devstack sudo[105350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-22227f0e-289b-41ab-8de9-b0f664d36e34 1073741824
Jul 09 09:22:45 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-quobyte-0529ff00-5506-495a-acb8-84d91e732be9" released by "delete_volume" :: held 1.648s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:45 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e (1ee3c9ad-33d8-4df7-9902-569eac055b8e): created successfully
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6051ccf1-dfa9-4cc9-98e3-7c32e9c7a4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Flow 'volume_create_manager' (bde72016-8b7a-4fea-8d3d-4966d0b62b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:45 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d2cb03ef-b92d-486e-944c-29a809119b84 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Created volume successfully.
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Created reservations ['cd972777-d87f-458d-8c8f-a27d311b444b', 'afe3bc87-cd1e-4297-9bca-005798c89671', '3e810925-7e86-4113-8155-a5aa830bf6c9', '1d0d7dca-8302-433c-bd3f-9888b6dc5711'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:45 devstack sudo[105352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:45 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:46 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-22227f0e-289b-41ab-8de9-b0f664d36e34 1073741824" returned: 0 in 1.046s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:46 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.843s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:46 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:46 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Deleted volume successfully.
Jul 09 09:22:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-22227f0e-289b-41ab-8de9-b0f664d36e34 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:46 devstack sudo[105359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-22227f0e-289b-41ab-8de9-b0f664d36e34
Jul 09 09:22:46 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f382302b-42ee-4405-9521-c426979830c4 tempest-VolumeDependencyTests-925184987 None] Lock "cinder-0529ff00-5506-495a-acb8-84d91e732be9-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:47 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-22227f0e-289b-41ab-8de9-b0f664d36e34" returned: 0 in 0.788s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.276s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1010589473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ca639f-77a0-48bd-a2d3-18b498609511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fae9a443ed461189490623fb08ae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:41Z,use_quota=True,user_id='dae5b8f966204555af907804d8f6102c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Creating volume 50ca639f-77a0-48bd-a2d3-18b498609511 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:47 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-50ca639f-77a0-48bd-a2d3-18b498609511 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:47 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-50ca639f-77a0-48bd-a2d3-18b498609511 1073741824
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f725bdf-7489-49f6-bd98-1e0b799357e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22227f0e-289b-41ab-8de9-b0f664d36e34', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:47 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbd0306-266b-4aaf-9070-537da2e7809f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:47 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume volume-22227f0e-289b-41ab-8de9-b0f664d36e34 (22227f0e-289b-41ab-8de9-b0f664d36e34): created successfully
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbd0306-266b-4aaf-9070-537da2e7809f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Flow 'volume_create_manager' (7565cff2-b580-4b7f-8131-1cdb138fadde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:47 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-8212cecf-f27b-407a-8529-4f83a4b0bb22 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Created volume successfully.
Jul 09 09:22:48 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-50ca639f-77a0-48bd-a2d3-18b498609511 1073741824" returned: 0 in 0.947s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-50ca639f-77a0-48bd-a2d3-18b498609511 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:48 devstack sudo[105368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-50ca639f-77a0-48bd-a2d3-18b498609511
Jul 09 09:22:48 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:48 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-50ca639f-77a0-48bd-a2d3-18b498609511" returned: 0 in 0.707s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.482s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-588700409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e1c6e5-dcd6-40ee-90d9-d87e0e17179d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fae9a443ed461189490623fb08ae17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:41Z,use_quota=True,user_id='dae5b8f966204555af907804d8f6102c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Creating volume 46e1c6e5-dcd6-40ee-90d9-d87e0e17179d {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:48 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:22:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa2d41d-f8b3-4796-b367-32af917960c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ca639f-77a0-48bd-a2d3-18b498609511', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:49 devstack sudo[105371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d 1073741824
Jul 09 09:22:49 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae221e1b-e83b-409a-a93e-73afc38a873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:49 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume volume-50ca639f-77a0-48bd-a2d3-18b498609511 (50ca639f-77a0-48bd-a2d3-18b498609511): created successfully
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae221e1b-e83b-409a-a93e-73afc38a873a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Flow 'volume_create_manager' (6ca983c4-56ff-4627-84a5-4cd779270dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:49 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-4bb1c4a2-01e9-4864-8cce-6840bc5a1dac tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Created volume successfully.
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Flow 'volume_create_manager' (6eea6c40-5603-4889-91d6-3896d073367e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d133ca0-b22b-46aa-a848-c63bff19fa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d133ca0-b22b-46aa-a848-c63bff19fa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a101e27-0071-45ba-b755-7791935aed0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19a3311cfdf4e08857ccdce13c54624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:49Z,use_quota=True,user_id='26c3a3e101244939a2a23bf5244d0b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98bc589-6180-40d0-9811-f55023996346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98bc589-6180-40d0-9811-f55023996346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea48e47-514b-42d5-8af0-6c0c613eab43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea48e47-514b-42d5-8af0-6c0c613eab43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a101e27-0071-45ba-b755-7791935aed0c', 'volume_name': 'volume-1a101e27-0071-45ba-b755-7791935aed0c', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dba086a-c70f-47f0-a77b-a91388bd5940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dba086a-c70f-47f0-a77b-a91388bd5940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db23840-56b8-4f52-a6e7-6cc88b33f47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:49 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Volume 1a101e27-0071-45ba-b755-7791935aed0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a101e27-0071-45ba-b755-7791935aed0c', 'volume_size': 1}
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:49 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d 1073741824" returned: 0 in 0.958s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:50 devstack sudo[105377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d
Jul 09 09:22:50 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:50 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d" returned: 0 in 0.674s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.157s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33fbe10-614d-4a48-858f-b654e5205321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc8f542-7794-4165-9830-ab75d912d9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] Creating offline snapshot fb8a7d2d-8ebe-44b6-931b-ff50c02a7770 of volume d18d2b33-c821-4df2-9960-ae779cdfc93d {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:22:50 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Volume volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d (46e1c6e5-dcd6-40ee-90d9-d87e0e17179d): created successfully
Jul 09 09:22:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc8f542-7794-4165-9830-ab75d912d9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Flow 'volume_create_manager' (cbf9ec0a-7272-4d35-8c19-799f6d88d6e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:50 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[551f65cf-8d8c-4d12-8fb5-8b2a440b5e53]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:50 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-275f078f-a720-4266-bbcf-f2e87877645e tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Created volume successfully.
Jul 09 09:22:50 devstack sudo[105380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d
Jul 09 09:22:50 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "cinder-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "cinder-quobyte-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-quobyte-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d" acquired by "delete_volume" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:51 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81e59c9-de5f-464e-bab5-a1f54e151a05]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:51 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d" returned: 0 in 0.820s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:51 devstack sudo[105386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770 1G
Jul 09 09:22:51 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:51 devstack sudo[105385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d
Jul 09 09:22:51 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:52 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d" returned: 0 in 0.825s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:52 devstack sudo[105395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d
Jul 09 09:22:52 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:52 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770 1G" returned: 0 in 1.068s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d18d2b33-c821-4df2-9960-ae779cdfc93d -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:52 devstack sudo[105397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d18d2b33-c821-4df2-9960-ae779cdfc93d -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770
Jul 09 09:22:52 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:53 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d" returned: 0 in 0.761s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-quobyte-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d" released by "delete_volume" :: held 1.642s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Created reservations ['8f1d199f-90a8-4a97-832e-99586a56cbe9', '7ab3b49d-481d-4644-88df-1b101224f3b5', 'd46e8f74-1b87-494d-9fa7-9178c8ede47f', '1b18c243-cb38-429e-b5fc-916dff728737'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:53 devstack sudo[105402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:53 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:53 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d18d2b33-c821-4df2-9960-ae779cdfc93d -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770" returned: 0 in 0.748s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:53 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770 is being set with open permissions: ugo+rw
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:53 devstack sudo[105406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770
Jul 09 09:22:53 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "cinder-50ca639f-77a0-48bd-a2d3-18b498609511-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-50ca639f-77a0-48bd-a2d3-18b498609511-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "cinder-quobyte-50ca639f-77a0-48bd-a2d3-18b498609511" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-quobyte-50ca639f-77a0-48bd-a2d3-18b498609511" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a6ade3-0551-42d0-925d-6d2a04d5b7e1]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-50ca639f-77a0-48bd-a2d3-18b498609511 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:53 devstack sudo[105408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-50ca639f-77a0-48bd-a2d3-18b498609511
Jul 09 09:22:53 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:54 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:54 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.921s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770" returned: 0 in 0.786s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:54 devstack sudo[105412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:54 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:54 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Deleted volume successfully.
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad588bf6-0ea8-48bf-a0fb-80a2ac41330d tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-46e1c6e5-dcd6-40ee-90d9-d87e0e17179d-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:54 devstack sudo[105414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.info
Jul 09 09:22:54 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:54 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-50ca639f-77a0-48bd-a2d3-18b498609511" returned: 0 in 0.882s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-50ca639f-77a0-48bd-a2d3-18b498609511 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:54 devstack sudo[105419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-50ca639f-77a0-48bd-a2d3-18b498609511
Jul 09 09:22:54 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:54 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.804s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:22:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:22:55 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.info" returned: 0 in 0.933s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:55 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.info is being set with open permissions: ugo+rw
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:55 devstack sudo[105423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.info
Jul 09 09:22:55 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:55 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-50ca639f-77a0-48bd-a2d3-18b498609511" returned: 0 in 0.799s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-quobyte-50ca639f-77a0-48bd-a2d3-18b498609511" released by "delete_volume" :: held 1.750s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Created reservations ['c6283e16-b00c-4258-affa-d2d0abb6054b', 'f78c4b66-6af5-45f1-8615-4f77eb8e83a3', 'e3cfad1c-12b8-474a-85f3-b0732afacb8b', '6402c5b1-ac65-40ec-961c-256c193458ea'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:55 devstack sudo[105426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:55 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:55 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.info" returned: 0 in 0.707s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.235s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.266s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a101e27-0071-45ba-b755-7791935aed0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19a3311cfdf4e08857ccdce13c54624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:22:49Z,use_quota=True,user_id='26c3a3e101244939a2a23bf5244d0b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Creating volume 1a101e27-0071-45ba-b755-7791935aed0c {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:22:55 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a101e27-0071-45ba-b755-7791935aed0c 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "cinder-22227f0e-289b-41ab-8de9-b0f664d36e34-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:55 devstack sudo[105429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a101e27-0071-45ba-b755-7791935aed0c 1073741824
Jul 09 09:22:55 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:55 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-cb080cb2-2859-4b52-9772-756a6dddf172 tempest-ProjectMemberTests-1928387478 None] Create snapshot completed successfully
Jul 09 09:22:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-22227f0e-289b-41ab-8de9-b0f664d36e34-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "cinder-quobyte-22227f0e-289b-41ab-8de9-b0f664d36e34" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-quobyte-22227f0e-289b-41ab-8de9-b0f664d36e34" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:56 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[17eb9d48-0368-41c1-9143-48a732af8843]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-22227f0e-289b-41ab-8de9-b0f664d36e34 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:56 devstack sudo[105431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-22227f0e-289b-41ab-8de9-b0f664d36e34
Jul 09 09:22:56 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:56 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.801s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:56 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:56 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Deleted volume successfully.
Jul 09 09:22:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-013e6027-1dc6-48b6-9649-036185c76831 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-50ca639f-77a0-48bd-a2d3-18b498609511-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:56 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-22227f0e-289b-41ab-8de9-b0f664d36e34" returned: 0 in 0.863s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-22227f0e-289b-41ab-8de9-b0f664d36e34 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:56 devstack sudo[105441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-22227f0e-289b-41ab-8de9-b0f664d36e34
Jul 09 09:22:56 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-fb8a7d2d-8ebe-44b6-931b-ff50c02a7770-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Lock "cinder-fb8a7d2d-8ebe-44b6-931b-ff50c02a7770-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-d18d2b33-c821-4df2-9960-ae779cdfc93d" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:57 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a101e27-0071-45ba-b755-7791935aed0c 1073741824" returned: 0 in 1.199s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-d18d2b33-c821-4df2-9960-ae779cdfc93d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-fb8a7d2d-8ebe-44b6-931b-ff50c02a7770" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-fb8a7d2d-8ebe-44b6-931b-ff50c02a7770" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Deleting offline snapshot fb8a7d2d-8ebe-44b6-931b-ff50c02a7770 of volume d18d2b33-c821-4df2-9960-ae779cdfc93d {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] snapshot_file for this snap is: volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a101e27-0071-45ba-b755-7791935aed0c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a4d873-c5e6-4f9c-b43a-7f86ec9f453a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:57 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a101e27-0071-45ba-b755-7791935aed0c
Jul 09 09:22:57 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:57 devstack sudo[105444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770
Jul 09 09:22:57 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:57 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-22227f0e-289b-41ab-8de9-b0f664d36e34" returned: 0 in 0.810s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-quobyte-22227f0e-289b-41ab-8de9-b0f664d36e34" released by "delete_volume" :: held 1.737s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Created reservations ['20eb9ce1-f176-47ab-93c2-b9af0d389a62', '9e31e360-1165-403f-a24a-ffbc35aab9c1', '3a70403d-579f-4d5d-b155-8dbfa0f29290', 'd58903b1-0461-4630-a938-0c1a429d83ad'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:22:57 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a101e27-0071-45ba-b755-7791935aed0c" returned: 0 in 0.740s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:22:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db23840-56b8-4f52-a6e7-6cc88b33f47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a101e27-0071-45ba-b755-7791935aed0c', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:58 devstack sudo[105451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:22:58 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727c5eec-a38e-44dd-902a-d2bfa1b065a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:58 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Volume volume-1a101e27-0071-45ba-b755-7791935aed0c (1a101e27-0071-45ba-b755-7791935aed0c): created successfully
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727c5eec-a38e-44dd-902a-d2bfa1b065a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Flow 'volume_create_manager' (6eea6c40-5603-4889-91d6-3896d073367e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:58 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e7682f9d-cd2e-4726-8a1e-12530bfd69fc tempest-CinderUnicodeTest-1063733121 None] Created volume successfully.
Jul 09 09:22:58 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770" returned: 0 in 1.003s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d18d2b33-c821-4df2-9960-ae779cdfc93d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e86d92b-c16b-4e91-b704-617392e6634f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "cinder-1ee3c9ad-33d8-4df7-9902-569eac055b8e-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-1ee3c9ad-33d8-4df7-9902-569eac055b8e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "cinder-quobyte-1ee3c9ad-33d8-4df7-9902-569eac055b8e" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:22:58 devstack sudo[105454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d
Jul 09 09:22:58 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-quobyte-1ee3c9ad-33d8-4df7-9902-569eac055b8e" acquired by "delete_volume" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e9eb71-974f-43f5-9212-14c59a3fdc74]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:58 devstack sudo[105456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e
Jul 09 09:22:58 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:58 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.845s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:22:58 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Deleted volume successfully.
Jul 09 09:22:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d4e62dea-3caf-4f57-aac9-63d9f1722171 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-22227f0e-289b-41ab-8de9-b0f664d36e34-delete_volume" released by "delete_volume" :: held 2.854s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:22:59 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d" returned: 0 in 1.009s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:59 devstack sudo[105463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770
Jul 09 09:22:59 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:59 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e" returned: 0 in 1.113s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:22:59 devstack sudo[105469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e
Jul 09 09:22:59 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Flow 'volume_create_manager' (5333ecb6-15db-40c2-b7e2-f09174d77a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01dbf717-3d64-4aa5-9493-cd673c4d2aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01dbf717-3d64-4aa5-9493-cd673c4d2aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1661245233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a63b26c-bd16-4acf-a87b-a9022f53ef95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19a3311cfdf4e08857ccdce13c54624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:00Z,use_quota=True,user_id='26c3a3e101244939a2a23bf5244d0b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd5cbda-f241-4b7c-ad09-80149a5adca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd5cbda-f241-4b7c-ad09-80149a5adca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7c0b37-91a9-406e-a207-5ad30f068342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7c0b37-91a9-406e-a207-5ad30f068342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a63b26c-bd16-4acf-a87b-a9022f53ef95', 'volume_name': 'volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c58c2a-731d-4873-8e85-3065f2415e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c58c2a-731d-4873-8e85-3065f2415e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fff0d8-7f07-47c4-970f-a6c7442b2664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:22:59 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Volume 7a63b26c-bd16-4acf-a87b-a9022f53ef95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95', 'volume_size': 1}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1661245233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a63b26c-bd16-4acf-a87b-a9022f53ef95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19a3311cfdf4e08857ccdce13c54624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:00Z,use_quota=True,user_id='26c3a3e101244939a2a23bf5244d0b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Creating volume 7a63b26c-bd16-4acf-a87b-a9022f53ef95 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:22:59 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:23:00 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:00 devstack sudo[105473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95 1073741824
Jul 09 09:23:00 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:00 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770" returned: 0 in 0.902s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:00 devstack sudo[105477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770
Jul 09 09:23:00 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:00 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1ee3c9ad-33d8-4df7-9902-569eac055b8e" returned: 0 in 0.810s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-quobyte-1ee3c9ad-33d8-4df7-9902-569eac055b8e" released by "delete_volume" :: held 1.990s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Created reservations ['8a9ad4f5-9422-4e7f-8b35-5ca4e5149cec', 'ee07ba6e-cfa1-4fb0-b3fc-dfafae4ed883', '25fe2c93-885f-4133-b0e7-d55d4f5adc4c', 'a9c5ea9f-872d-42a2-9742-c33eed8ced7d'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:00 devstack sudo[105481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:23:00 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "cinder-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "cinder-quobyte-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-quobyte-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a42753-2c41-4cc2-88ec-cffbb146170d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:01 devstack sudo[105485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4
Jul 09 09:23:01 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:01 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95 1073741824" returned: 0 in 1.142s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:01 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d.fb8a7d2d-8ebe-44b6-931b-ff50c02a7770" returned: 0 in 1.054s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:01 devstack sudo[105490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95
Jul 09 09:23:01 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-fb8a7d2d-8ebe-44b6-931b-ff50c02a7770" released by "_delete_snapshot" :: held 4.184s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-d18d2b33-c821-4df2-9960-ae779cdfc93d" released by "delete_snapshot" :: held 4.227s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:01 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Created reservations ['999347dd-f354-4fd6-9442-8c533c252d59', 'b5486a5b-8a89-4980-94e3-ca7c488c1657', '99ed7ab1-f54b-438e-9263-cf0340eecce3', '9a02c001-e1b7-43c3-8a1e-8701db410ff5'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:01 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Delete snapshot completed successfully.
Jul 09 09:23:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-db2156d0-d032-4494-842e-f414fc34e64c tempest-ProjectMemberTests-1928387478 None] Lock "cinder-fb8a7d2d-8ebe-44b6-931b-ff50c02a7770-delete_snapshot" released by "delete_snapshot" :: held 4.593s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:01 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.109s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:01 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:23:01 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Deleted volume successfully.
Jul 09 09:23:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-290d0c05-a358-48ef-95dd-b14eba8c8779 tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-1ee3c9ad-33d8-4df7-9902-569eac055b8e-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:01 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4" returned: 0 in 0.982s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:01 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4
Jul 09 09:23:01 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:02 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95" returned: 0 in 0.855s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fff0d8-7f07-47c4-970f-a6c7442b2664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778ed62f-9cc2-4bb7-9a84-4683f8f2c0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:02 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Volume volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95 (7a63b26c-bd16-4acf-a87b-a9022f53ef95): created successfully
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (778ed62f-9cc2-4bb7-9a84-4683f8f2c0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Flow 'volume_create_manager' (5333ecb6-15db-40c2-b7e2-f09174d77a5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:02 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5678cd82-10f8-4c37-b54a-3e1b483ee0df tempest-CinderUnicodeTest-1063733121 None] Created volume successfully.
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-d18d2b33-c821-4df2-9960-ae779cdfc93d-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-d18d2b33-c821-4df2-9960-ae779cdfc93d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-d18d2b33-c821-4df2-9960-ae779cdfc93d" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-d18d2b33-c821-4df2-9960-ae779cdfc93d" acquired by "delete_volume" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:02 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4" returned: 0 in 0.734s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4301743e-7fe7-4547-a884-f147a259f2d2]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-quobyte-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4" released by "delete_volume" :: held 1.781s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Created reservations ['410d1373-1524-4feb-ba51-5e5fec499ea3', 'de0898fc-37ec-4bc8-8ae1-d4c83ce4a026', '0217a769-1103-4b02-ad2c-417a1b8273dc', 'c5ab7792-59bb-47a8-8e0c-5368a927cee5'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:02 devstack sudo[105502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d
Jul 09 09:23:02 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:02 devstack sudo[105504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:23:02 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "cinder-6a3c547d-373e-4f48-a640-d5365bc5b581-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-6a3c547d-373e-4f48-a640-d5365bc5b581-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "cinder-quobyte-6a3c547d-373e-4f48-a640-d5365bc5b581" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-quobyte-6a3c547d-373e-4f48-a640-d5365bc5b581" acquired by "delete_volume" :: waited 0.029s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd05538-90d0-44d3-ad52-181215eb9b88]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6a3c547d-373e-4f48-a640-d5365bc5b581 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:03 devstack sudo[105506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6a3c547d-373e-4f48-a640-d5365bc5b581
Jul 09 09:23:03 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] Creating offline snapshot a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6 of volume 7a63b26c-bd16-4acf-a87b-a9022f53ef95 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[66936de3-90c2-4eb1-9f5c-d135db94fa72]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:03 devstack sudo[105511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95
Jul 09 09:23:03 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:03 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:03 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.082s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d" returned: 0 in 1.247s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:03 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Deleted volume successfully.
Jul 09 09:23:03 devstack sudo[105514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d
Jul 09 09:23:03 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-0d3ade25-26e3-41d1-9d2e-e7d4318d276f tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-a7847dde-e57d-4ed1-8cfb-2e0ba134cbf4-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:04 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6a3c547d-373e-4f48-a640-d5365bc5b581" returned: 0 in 1.077s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6a3c547d-373e-4f48-a640-d5365bc5b581 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:04 devstack sudo[105520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6a3c547d-373e-4f48-a640-d5365bc5b581
Jul 09 09:23:04 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:04 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95" returned: 0 in 1.078s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:04 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6 1G
Jul 09 09:23:04 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:04 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-d18d2b33-c821-4df2-9960-ae779cdfc93d" returned: 0 in 0.918s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-d18d2b33-c821-4df2-9960-ae779cdfc93d" released by "delete_volume" :: held 2.261s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:04 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Created reservations ['32e0e2a1-c592-44b1-afdf-46f51f42dabf', '7e352757-6408-408b-a3ce-4d1e9fef5e91', '44030238-9fcf-4223-a086-7bb03b68a0b4', 'ca8ff97e-cf32-49bc-b677-53fe13e56ef5'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:05 devstack sudo[105528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:23:05 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:05 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6a3c547d-373e-4f48-a640-d5365bc5b581" returned: 0 in 0.828s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-quobyte-6a3c547d-373e-4f48-a640-d5365bc5b581" released by "delete_volume" :: held 1.970s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Created reservations ['7773232c-c41c-423b-bed8-c361dbee375b', '6ad8d7c6-2f8c-4eec-8995-048f8a5ae5f4', '814148be-70de-476f-8a12-1badda28b3d0', '6cc9d3c3-8e0a-4ddf-9bd0-588ca07e4f72'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:05 devstack sudo[105534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:23:05 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:05 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.834s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:23:05 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Deleted volume successfully.
Jul 09 09:23:05 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6 1G" returned: 0 in 1.306s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-bb85dbc9-14f6-455f-9a0e-5929bf4278b0 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-d18d2b33-c821-4df2-9960-ae779cdfc93d-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:06 devstack sudo[105537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6
Jul 09 09:23:06 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:06 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.969s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:23:06 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Deleted volume successfully.
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-573b53ab-7a4a-4f9a-bad2-04599aafef9b tempest-CreateVolumesFromSourceVolumeTest-1985718199 None] Lock "cinder-6a3c547d-373e-4f48-a640-d5365bc5b581-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (8fb5b17c-a235-49a0-8858-eca8e203051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1fd2a97-b790-4201-97ce-b2f5e7bb0383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1fd2a97-b790-4201-97ce-b2f5e7bb0383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437529238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:07Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e27572-2761-473b-91b7-852216e7094c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e27572-2761-473b-91b7-852216e7094c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46ad295-58e1-4356-a394-0095d5d34386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46ad295-58e1-4356-a394-0095d5d34386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d', 'volume_name': 'volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ba5491-f8fe-4860-aa72-794918e91dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ba5491-f8fe-4860-aa72-794918e91dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb41e0d-00a5-44a9-ab3b-533e8af9e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:06 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Volume 2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d', 'volume_size': 1}
Jul 09 09:23:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:07 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6" returned: 0 in 1.115s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:07 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6 is being set with open permissions: ugo+rw
Jul 09 09:23:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:07 devstack sudo[105543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6
Jul 09 09:23:07 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:07 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6" returned: 0 in 0.861s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:07 devstack sudo[105546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.info
Jul 09 09:23:07 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:08 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.info" returned: 0 in 0.699s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:08 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.info is being set with open permissions: ugo+rw
Jul 09 09:23:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:08 devstack sudo[105549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.info
Jul 09 09:23:08 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:09 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.info" returned: 0 in 0.894s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.093s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.673s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437529238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:07Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:23:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Creating volume 2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:23:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:23:09 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:23:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:09 devstack sudo[105553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d 1073741824
Jul 09 09:23:09 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:09 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a88408e3-e420-4dec-a45a-3fe13ba0dab1 tempest-CinderUnicodeTest-1063733121 None] Create snapshot completed successfully
Jul 09 09:23:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Acquiring lock "cinder-a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Lock "cinder-a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Acquiring lock "cinder-quobyte-7a63b26c-bd16-4acf-a87b-a9022f53ef95" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Lock "cinder-quobyte-7a63b26c-bd16-4acf-a87b-a9022f53ef95" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Acquiring lock "cinder-quobyte-a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Lock "cinder-quobyte-a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Deleting offline snapshot a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6 of volume 7a63b26c-bd16-4acf-a87b-a9022f53ef95 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:23:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] snapshot_file for this snap is: volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:23:10 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e04f2e-5c42-43a8-a11a-f9aa665de5f5]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:10 devstack sudo[105555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6
Jul 09 09:23:10 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:10 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d 1073741824" returned: 0 in 1.295s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:11 devstack sudo[105560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d
Jul 09 09:23:11 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:11 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6" returned: 0 in 1.089s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:23:11 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[837306a1-615e-4832-b84f-1eadc3197fab]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:11 devstack sudo[105565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95
Jul 09 09:23:11 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:11 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d" returned: 0 in 0.982s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:11 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] <== create_volume: return (2356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:23:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.366s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:11 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb41e0d-00a5-44a9-ab3b-533e8af9e75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e972104-4ac4-4292-a82e-a10e55436bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:12 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Volume volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d (2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d): created successfully
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e972104-4ac4-4292-a82e-a10e55436bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (8fb5b17c-a235-49a0-8858-eca8e203051c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:12 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-ebdc6327-66a0-4556-9316-871273ab00db tempest-ProjectMemberTests-1928387478 None] Created volume successfully.
Jul 09 09:23:12 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95" returned: 0 in 0.937s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:12 devstack sudo[105571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6
Jul 09 09:23:12 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] Creating offline snapshot e7eac976-eb4b-4d39-b746-aea90fe379c7 of volume 2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Flow 'volume_create_manager' (f40cd817-98de-4a5c-9430-b7062eae1fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda1d140-3352-4dba-915c-7b1c9d692063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c333e971-e0c3-4d8d-902c-379e14bcf7f8]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda1d140-3352-4dba-915c-7b1c9d692063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-43428288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706e561b-ca4d-4379-b95e-44b127e1466e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5b6ed290024d9cac5f36f001ca73cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:13Z,use_quota=True,user_id='d9ae9fa6007148b7aa2dca9c3d558c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222260a6-9dc7-4e35-a38b-8c031da9f960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222260a6-9dc7-4e35-a38b-8c031da9f960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09af3b3-c422-438e-a614-a1e69f52dee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09af3b3-c422-438e-a614-a1e69f52dee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '706e561b-ca4d-4379-b95e-44b127e1466e', 'volume_name': 'volume-706e561b-ca4d-4379-b95e-44b127e1466e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50cb04c-9794-4c29-bbeb-d328aef130e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50cb04c-9794-4c29-bbeb-d328aef130e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dd95b8-9773-4074-b9ac-13bdb51d66c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:12 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Volume 706e561b-ca4d-4379-b95e-44b127e1466e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-706e561b-ca4d-4379-b95e-44b127e1466e', 'volume_size': 1}
Jul 09 09:23:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:12 devstack sudo[105575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d
Jul 09 09:23:12 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:13 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6" returned: 0 in 0.820s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:13 devstack sudo[105580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6
Jul 09 09:23:13 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:13 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d" returned: 0 in 0.818s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:13 devstack sudo[105586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7 1G
Jul 09 09:23:13 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:13 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95.a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6" returned: 0 in 0.707s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Lock "cinder-quobyte-a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6" released by "_delete_snapshot" :: held 3.734s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Lock "cinder-quobyte-7a63b26c-bd16-4acf-a87b-a9022f53ef95" released by "delete_snapshot" :: held 3.791s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:13 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Created reservations ['bc514a1b-3522-494a-adac-16f5723041ca', '919456a3-6c1f-4eae-bfea-aa76b18dc1b9', '8dc22118-d1ec-4a71-a815-266447d61d65', '850adc07-b941-412d-81fb-7bbac7073901'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Delete snapshot completed successfully.
Jul 09 09:23:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e7774083-f5cc-4631-a305-92838c68c6c0 tempest-CinderUnicodeTest-1063733121 None] Lock "cinder-a52b988e-dbe3-43d1-8b3d-f7a0b7e740e6-delete_snapshot" released by "delete_snapshot" :: held 3.968s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Acquiring lock "cinder-7a63b26c-bd16-4acf-a87b-a9022f53ef95-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Lock "cinder-7a63b26c-bd16-4acf-a87b-a9022f53ef95-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Acquiring lock "cinder-quobyte-7a63b26c-bd16-4acf-a87b-a9022f53ef95" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Lock "cinder-quobyte-7a63b26c-bd16-4acf-a87b-a9022f53ef95" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:14 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8cb690-af42-4237-a119-95ef43d8e3e2]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:14 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7 1G" returned: 0 in 0.953s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:14 devstack sudo[105593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7
Jul 09 09:23:14 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:14 devstack sudo[105592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95
Jul 09 09:23:14 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:15 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7" returned: 0 in 0.679s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:15 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7 is being set with open permissions: ugo+rw
Jul 09 09:23:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:15 devstack sudo[105602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7
Jul 09 09:23:15 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:15 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95" returned: 0 in 0.789s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:15 devstack sudo[105604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95
Jul 09 09:23:15 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:15 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7" returned: 0 in 0.674s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:16 devstack sudo[105608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.info
Jul 09 09:23:16 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:16 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7a63b26c-bd16-4acf-a87b-a9022f53ef95" returned: 0 in 0.798s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Lock "cinder-quobyte-7a63b26c-bd16-4acf-a87b-a9022f53ef95" released by "delete_volume" :: held 1.678s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Created reservations ['68d911de-cddb-4fdc-a2f3-4d773df04e9a', 'd453227b-0a2b-4188-bd8f-cc8d67acdba8', '95aebaad-dbce-431a-8cc4-cfa44c68eadb', '0c86c44c-c6eb-415f-8ee0-f8fbaba2d5e2'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:16 devstack sudo[105610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:23:16 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Acquiring lock "cinder-1a101e27-0071-45ba-b755-7791935aed0c-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Lock "cinder-1a101e27-0071-45ba-b755-7791935aed0c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Acquiring lock "cinder-quobyte-1a101e27-0071-45ba-b755-7791935aed0c" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Lock "cinder-quobyte-1a101e27-0071-45ba-b755-7791935aed0c" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:16 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.info" returned: 0 in 0.858s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:16 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.info is being set with open permissions: ugo+rw
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7a8c67-9081-41fb-b8f9-3678561b1664]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a101e27-0071-45ba-b755-7791935aed0c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:16 devstack sudo[105613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.info
Jul 09 09:23:16 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:16 devstack sudo[105614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a101e27-0071-45ba-b755-7791935aed0c
Jul 09 09:23:16 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:17 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.693s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:23:17 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Deleted volume successfully.
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-eaa8b84c-5306-4980-b13d-52b0b9fc533f tempest-CinderUnicodeTest-1063733121 None] Lock "cinder-7a63b26c-bd16-4acf-a87b-a9022f53ef95-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:17 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.info" returned: 0 in 0.648s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.753s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.622s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-43428288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706e561b-ca4d-4379-b95e-44b127e1466e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5b6ed290024d9cac5f36f001ca73cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:13Z,use_quota=True,user_id='d9ae9fa6007148b7aa2dca9c3d558c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Creating volume 706e561b-ca4d-4379-b95e-44b127e1466e {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:23:17 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:17 devstack sudo[105622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e 1073741824
Jul 09 09:23:17 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:17 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-619cc409-f618-4192-9871-e9c671fd0283 tempest-ProjectMemberTests-1928387478 None] Create snapshot completed successfully
Jul 09 09:23:17 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a101e27-0071-45ba-b755-7791935aed0c" returned: 0 in 0.836s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a101e27-0071-45ba-b755-7791935aed0c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:17 devstack sudo[105625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a101e27-0071-45ba-b755-7791935aed0c
Jul 09 09:23:17 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-e7eac976-eb4b-4d39-b746-aea90fe379c7-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-e7eac976-eb4b-4d39-b746-aea90fe379c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:17 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-e7eac976-eb4b-4d39-b746-aea90fe379c7" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-e7eac976-eb4b-4d39-b746-aea90fe379c7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Deleting offline snapshot e7eac976-eb4b-4d39-b746-aea90fe379c7 of volume 2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] snapshot_file for this snap is: volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ada55d-567f-4362-a002-e8a7ac61604d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:18 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7
Jul 09 09:23:18 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:18 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-1a101e27-0071-45ba-b755-7791935aed0c" returned: 0 in 0.806s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Lock "cinder-quobyte-1a101e27-0071-45ba-b755-7791935aed0c" released by "delete_volume" :: held 1.698s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:18 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e 1073741824" returned: 0 in 1.021s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Created reservations ['2cf72e41-775a-45ab-bec5-152aff23b289', 'a2b9d464-7717-49a3-a30f-8b9b3539e782', '84efe77f-4802-41a2-b35b-b2144455fb8f', '3edb6053-909d-47c5-971c-42ca07310db3'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:18 devstack sudo[105634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e
Jul 09 09:23:18 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:18 devstack sudo[105636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:23:18 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:19 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7" returned: 0 in 1.073s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:23:19 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37babae-6aeb-4ad2-889e-e60e8391f889]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:19 devstack sudo[105641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d
Jul 09 09:23:19 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:19 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e" returned: 0 in 0.947s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:23:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dd95b8-9773-4074-b9ac-13bdb51d66c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-706e561b-ca4d-4379-b95e-44b127e1466e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf8af84-0ecd-4cf7-b21c-36d5f5cec85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:19 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Volume volume-706e561b-ca4d-4379-b95e-44b127e1466e (706e561b-ca4d-4379-b95e-44b127e1466e): created successfully
Jul 09 09:23:19 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf8af84-0ecd-4cf7-b21c-36d5f5cec85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Flow 'volume_create_manager' (f40cd817-98de-4a5c-9430-b7062eae1fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.933s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:19 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:23:19 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Deleted volume successfully.
Jul 09 09:23:19 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-50a6cd2f-c9d6-47c1-8232-3b967f6eaf76 tempest-SnapshotDependencyTests-1953880461 None] Created volume successfully.
Jul 09 09:23:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-f43b03c4-db68-4e48-9b8f-2f242300144b tempest-CinderUnicodeTest-1063733121 None] Lock "cinder-1a101e27-0071-45ba-b755-7791935aed0c-delete_volume" released by "delete_volume" :: held 2.958s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:20 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d" returned: 0 in 1.092s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:20 devstack sudo[105650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7
Jul 09 09:23:20 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] Creating offline snapshot 2aa515ef-c2a4-414a-8731-0d69bdb82270 of volume 706e561b-ca4d-4379-b95e-44b127e1466e {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:23:20 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ccbf31-ff2b-43d3-8bb8-a3127584a8d8]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:20 devstack sudo[105652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e
Jul 09 09:23:20 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:21 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7" returned: 0 in 0.906s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:21 devstack sudo[105658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7
Jul 09 09:23:21 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:21 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e" returned: 0 in 0.882s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:21 devstack sudo[105664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270 1G
Jul 09 09:23:21 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:21 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d.e7eac976-eb4b-4d39-b746-aea90fe379c7" returned: 0 in 0.761s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-e7eac976-eb4b-4d39-b746-aea90fe379c7" released by "_delete_snapshot" :: held 3.981s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d" released by "delete_snapshot" :: held 4.013s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:22 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Created reservations ['e6880f3d-fd34-41c1-875d-1a5913435d1a', '4896e635-1254-4898-8d2e-4840479533f6', '71840285-4dac-4c7c-9e80-ebe1da3c032e', '227d56ac-6924-4589-8737-d55f66a6e7e4'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:22 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Delete snapshot completed successfully.
Jul 09 09:23:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3943bb83-6d46-426b-a546-22206d318737 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-e7eac976-eb4b-4d39-b746-aea90fe379c7-delete_snapshot" released by "delete_snapshot" :: held 4.204s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:22 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f672b8-c65e-4c15-9eda-58aebcb4f8ec]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:22 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270 1G" returned: 0 in 1.058s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-706e561b-ca4d-4379-b95e-44b127e1466e -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:22 devstack sudo[105674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-706e561b-ca4d-4379-b95e-44b127e1466e -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270
Jul 09 09:23:22 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:22 devstack sudo[105671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d
Jul 09 09:23:22 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:23 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-706e561b-ca4d-4379-b95e-44b127e1466e -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270" returned: 0 in 0.848s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:23 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270 is being set with open permissions: ugo+rw
Jul 09 09:23:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:23 devstack sudo[105684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270
Jul 09 09:23:23 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:23 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d" returned: 0 in 0.946s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:23 devstack sudo[105686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d
Jul 09 09:23:23 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:23 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-664004da-304c-4903-857f-f587d24884fa tempest-ProjectAdminTests-708210278 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87009) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 09 09:23:23 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270" returned: 0 in 0.678s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:24 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d" returned: 0 in 0.684s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:24 devstack sudo[105690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.info
Jul 09 09:23:24 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d" released by "delete_volume" :: held 1.708s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Created reservations ['0853ca98-09af-421c-a5ec-c92f33c74584', '3ed7801f-d39f-4213-adf6-6ef4c556162b', '7a6affa5-fac1-42d5-82d9-137cab604942', '8d4c16ef-85f4-414a-b6c6-a917b57662cb'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:24 devstack sudo[105692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:23:24 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:24 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.info" returned: 0 in 0.792s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:24 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.info is being set with open permissions: ugo+rw
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:24 devstack sudo[105696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.info
Jul 09 09:23:24 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:24 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.735s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:23:24 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Deleted volume successfully.
Jul 09 09:23:24 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-89401c3c-7aed-4c31-89cb-ffa720596f15 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-2d1c16a1-88a9-4ad7-b9bf-ab15fdd07b4d-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (092cf0bb-64e0-45ae-adf2-a6db29d81465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1042e09-d30b-4711-abab-71b85d66ba15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1042e09-d30b-4711-abab-71b85d66ba15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2002838149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d696cc7-7d34-444f-9017-073ab23bef3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:25Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9ff500-e52e-4c85-a687-89a0045873a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9ff500-e52e-4c85-a687-89a0045873a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f538d0-f4e9-449c-9aae-113ad8fe8c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f538d0-f4e9-449c-9aae-113ad8fe8c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d696cc7-7d34-444f-9017-073ab23bef3a', 'volume_name': 'volume-9d696cc7-7d34-444f-9017-073ab23bef3a', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6c9534-b8b1-487e-95eb-454be3801125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6c9534-b8b1-487e-95eb-454be3801125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a7296d-0e10-4256-a1b1-672461be35d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:25 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Volume 9d696cc7-7d34-444f-9017-073ab23bef3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d696cc7-7d34-444f-9017-073ab23bef3a', 'volume_size': 1}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:25 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.info" returned: 0 in 0.879s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.254s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.422s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2002838149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d696cc7-7d34-444f-9017-073ab23bef3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:25Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Creating volume 9d696cc7-7d34-444f-9017-073ab23bef3a {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:23:25 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:23:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:25 devstack sudo[105699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a 1073741824
Jul 09 09:23:25 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:25 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e62dd6b7-83e7-4f2e-b6b8-ec05840f4807 tempest-SnapshotDependencyTests-1953880461 None] Create snapshot completed successfully
Jul 09 09:23:26 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:23:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Flow 'volume_create_manager' (2dff5967-2673-4c2c-9a85-8dc26aeda087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01c3d76-e2b9-4ab1-9565-526e4539f1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01c3d76-e2b9-4ab1-9565-526e4539f1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5b6ed290024d9cac5f36f001ca73cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2aa515ef-c2a4-414a-8731-0d69bdb82270,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:27Z,use_quota=True,user_id='d9ae9fa6007148b7aa2dca9c3d558c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e850661-5cde-437c-b201-81ac6ef7fd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e850661-5cde-437c-b201-81ac6ef7fd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147fa2b8-7c28-49cd-9794-8a9c999ba453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147fa2b8-7c28-49cd-9794-8a9c999ba453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14', 'volume_name': 'volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14', 'volume_size': 1, 'snapshot_id': '2aa515ef-c2a4-414a-8731-0d69bdb82270'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091d354b-d9bc-427c-85c4-5b591dcbd5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091d354b-d9bc-427c-85c4-5b591dcbd5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:26 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca793db-07ae-448c-9928-91323844618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:26 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Volume fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14', 'volume_size': 1, 'snapshot_id': '2aa515ef-c2a4-414a-8731-0d69bdb82270'}
Jul 09 09:23:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:26 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a 1073741824" returned: 0 in 1.047s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:26 devstack sudo[105705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a
Jul 09 09:23:26 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:27 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a" returned: 0 in 0.744s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.863s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "cinder-quobyte-2aa515ef-c2a4-414a-8731-0d69bdb82270-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14" by "_create_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a7296d-0e10-4256-a1b1-672461be35d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d696cc7-7d34-444f-9017-073ab23bef3a', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb14c97-b9cb-4f27-ae62-2988e3669c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-quobyte-2aa515ef-c2a4-414a-8731-0d69bdb82270-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Creating volume fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14 from snapshot 2aa515ef-c2a4-414a-8731-0d69bdb82270 {{(pid=87009) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "cinder-quobyte-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14" by "_copy_volume_from_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:27 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Volume volume-9d696cc7-7d34-444f-9017-073ab23bef3a (9d696cc7-7d34-444f-9017-073ab23bef3a): created successfully
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb14c97-b9cb-4f27-ae62-2988e3669c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (092cf0bb-64e0-45ae-adf2-a6db29d81465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-quobyte-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] snapshot: 2aa515ef-c2a4-414a-8731-0d69bdb82270, volume: fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14,  {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 09 09:23:27 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-501fe386-62f1-41fc-9fc2-b2514430dcfa tempest-ProjectMemberTests-1928387478 None] Created volume successfully.
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9843a4a-4222-4d55-a84f-7f9b503dec7e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:27 devstack sudo[105744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270
Jul 09 09:23:27 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:28 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270" returned: 0 in 0.887s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-706e561b-ca4d-4379-b95e-44b127e1466e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:23:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] will copy from snapshot at /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 09 09:23:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Creating direct copy from snapshot {{(pid=87009) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 09 09:23:28 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bfa675-cd77-4804-adcd-0239fb5635f4]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:28 devstack sudo[105750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e
Jul 09 09:23:28 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:29 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e" returned: 0 in 0.824s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:29 devstack cinder-volume[87009]: DEBUG cinder.utils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Path /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14 not found in is_blk_device check {{(pid=87009) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 09 09:23:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:29 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14
Jul 09 09:23:29 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:35 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14" returned: 0 in 6.051s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:35 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb65168-fd5c-4b57-8fa4-77e298e18adc]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:35 devstack sudo[105775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e
Jul 09 09:23:35 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:36 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e" returned: 0 in 1.003s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:36 devstack cinder-volume[87009]: DEBUG cinder.image.image_utils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Image conversion details: src /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14 {{(pid=87009) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 09 09:23:36 devstack cinder-volume[87009]: INFO cinder.image.image_utils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Converted 1024.00 MB image at 169.18 MB/s
Jul 09 09:23:36 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14 is being set with open permissions: ugo+rw
Jul 09 09:23:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:36 devstack sudo[105780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14
Jul 09 09:23:36 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:37 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14" returned: 0 in 0.683s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-quobyte-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14" released by "_copy_volume_from_snapshot" :: held 9.595s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-quobyte-2aa515ef-c2a4-414a-8731-0d69bdb82270-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14" released by "_create_volume_from_snapshot" :: held 9.657s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.707s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.558s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:DELETE=21,cinder:UPDATE=174,cinder:SELECT=121,cinder:INSERT=45 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=169,cinder:SELECT=128,cinder:DELETE=10,cinder:INSERT=40 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] Creating offline snapshot 85478870-63fa-47c8-b711-56e65bc995f9 of volume 9d696cc7-7d34-444f-9017-073ab23bef3a {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca793db-07ae-448c-9928-91323844618a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14', 'volume_size': 1, 'snapshot_id': '2aa515ef-c2a4-414a-8731-0d69bdb82270'}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1c242f-4c5c-43a6-be13-809e95a6e683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe18090-e799-45da-aaf5-ac31a3a543ad]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:37 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Volume volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14 (fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14): created successfully
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1c242f-4c5c-43a6-be13-809e95a6e683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Flow 'volume_create_manager' (2dff5967-2673-4c2c-9a85-8dc26aeda087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:37 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-306c2cf9-ff91-4556-b278-e36905104aaf tempest-SnapshotDependencyTests-1953880461 None] Created volume successfully.
Jul 09 09:23:37 devstack sudo[105783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a
Jul 09 09:23:37 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Flow 'volume_create_manager' (538ccf17-b353-41a5-91ac-408a6bce9407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c552a1-e705-45b9-a119-c88dfa5ac12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "cinder-2aa515ef-c2a4-414a-8731-0d69bdb82270-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c552a1-e705-45b9-a119-c88dfa5ac12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-862617279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13895bf9-d08f-4f21-8395-afffb220687e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6f656845904aa9b49ee5780aa968f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:38Z,use_quota=True,user_id='6d65a947fd8749069630184a47b0df8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b91d449-41f5-4b14-9344-dafb99275b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b91d449-41f5-4b14-9344-dafb99275b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0275cb73-9c6d-4a18-a11b-7f4b32697a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0275cb73-9c6d-4a18-a11b-7f4b32697a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13895bf9-d08f-4f21-8395-afffb220687e', 'volume_name': 'volume-13895bf9-d08f-4f21-8395-afffb220687e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60390c0f-14bb-4226-aba1-28d60696590c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60390c0f-14bb-4226-aba1-28d60696590c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353ceee0-02f1-4daa-a0dd-b3ff81ea6b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:37 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Volume 13895bf9-d08f-4f21-8395-afffb220687e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13895bf9-d08f-4f21-8395-afffb220687e', 'volume_size': 1}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-2aa515ef-c2a4-414a-8731-0d69bdb82270-delete_snapshot" acquired by "delete_snapshot" :: waited 0.087s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "cinder-quobyte-706e561b-ca4d-4379-b95e-44b127e1466e" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-quobyte-706e561b-ca4d-4379-b95e-44b127e1466e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "cinder-quobyte-2aa515ef-c2a4-414a-8731-0d69bdb82270" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-quobyte-2aa515ef-c2a4-414a-8731-0d69bdb82270" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Deleting offline snapshot 2aa515ef-c2a4-414a-8731-0d69bdb82270 of volume 706e561b-ca4d-4379-b95e-44b127e1466e {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] snapshot_file for this snap is: volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[393880ae-3900-47d2-8fba-a0f825970955]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:38 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270
Jul 09 09:23:38 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:38 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a" returned: 0 in 0.890s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:38 devstack sudo[105790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9 1G
Jul 09 09:23:38 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:38 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270" returned: 0 in 0.869s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:38 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-706e561b-ca4d-4379-b95e-44b127e1466e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:23:38 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf70c87-3104-473f-8955-1b3bcdd9dcf9]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:39 devstack sudo[105798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e
Jul 09 09:23:39 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:39 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9 1G" returned: 0 in 0.856s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d696cc7-7d34-444f-9017-073ab23bef3a -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:39 devstack sudo[105801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d696cc7-7d34-444f-9017-073ab23bef3a -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9
Jul 09 09:23:39 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:39 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e" returned: 0 in 0.801s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:39 devstack sudo[105809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270
Jul 09 09:23:39 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:39 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d696cc7-7d34-444f-9017-073ab23bef3a -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9" returned: 0 in 0.752s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:39 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9 is being set with open permissions: ugo+rw
Jul 09 09:23:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:39 devstack sudo[105813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9
Jul 09 09:23:39 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:40 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270" returned: 0 in 0.796s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:40 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270
Jul 09 09:23:40 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:40 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9" returned: 0 in 0.689s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:40 devstack sudo[105821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.info
Jul 09 09:23:40 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:41 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e.2aa515ef-c2a4-414a-8731-0d69bdb82270" returned: 0 in 0.762s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:41 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-quobyte-2aa515ef-c2a4-414a-8731-0d69bdb82270" released by "_delete_snapshot" :: held 3.351s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.info" returned: 0 in 0.712s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:41 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.info is being set with open permissions: ugo+rw
Jul 09 09:23:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-quobyte-706e561b-ca4d-4379-b95e-44b127e1466e" released by "delete_snapshot" :: held 3.390s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:41 devstack sudo[105825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.info
Jul 09 09:23:41 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:41 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Created reservations ['fe5a4988-8b65-47bc-8e6c-b509e06a0271', '513e2d78-6f53-4b15-a70e-ab24a6ecca27', 'f0d7a54d-47dd-4a11-841f-e8d0740a1eda', 'ea79219f-f825-4a5c-a5a6-53067858fe3f'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:41 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Delete snapshot completed successfully.
Jul 09 09:23:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-ad1bc312-40fa-4528-b9de-7e7927d66f8a tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-2aa515ef-c2a4-414a-8731-0d69bdb82270-delete_snapshot" released by "delete_snapshot" :: held 3.562s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:41 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.info" returned: 0 in 0.686s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.715s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.112s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-862617279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13895bf9-d08f-4f21-8395-afffb220687e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6f656845904aa9b49ee5780aa968f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:38Z,use_quota=True,user_id='6d65a947fd8749069630184a47b0df8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Creating volume 13895bf9-d08f-4f21-8395-afffb220687e {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:23:42 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:42 devstack sudo[105828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e 1073741824
Jul 09 09:23:42 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "cinder-706e561b-ca4d-4379-b95e-44b127e1466e-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:42 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-97eb6863-4466-4498-b1e6-eddedb1208d5 tempest-ProjectMemberTests-1928387478 None] Create snapshot completed successfully
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-706e561b-ca4d-4379-b95e-44b127e1466e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "cinder-quobyte-706e561b-ca4d-4379-b95e-44b127e1466e" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-quobyte-706e561b-ca4d-4379-b95e-44b127e1466e" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de4d74c-3065-4991-b762-481ce410eeb5]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:42 devstack sudo[105830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e
Jul 09 09:23:42 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-85478870-63fa-47c8-b711-56e65bc995f9-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Lock "cinder-85478870-63fa-47c8-b711-56e65bc995f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-9d696cc7-7d34-444f-9017-073ab23bef3a" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-9d696cc7-7d34-444f-9017-073ab23bef3a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-85478870-63fa-47c8-b711-56e65bc995f9" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-85478870-63fa-47c8-b711-56e65bc995f9" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Deleting offline snapshot 85478870-63fa-47c8-b711-56e65bc995f9 of volume 9d696cc7-7d34-444f-9017-073ab23bef3a {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] snapshot_file for this snap is: volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[83402c52-d127-413e-a172-3707cf93ab88]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:42 devstack sudo[105835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9
Jul 09 09:23:42 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:43 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e 1073741824" returned: 0 in 1.012s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:43 devstack sudo[105841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e
Jul 09 09:23:43 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:43 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e" returned: 0 in 0.968s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:43 devstack sudo[105843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e
Jul 09 09:23:43 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:43 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9" returned: 0 in 0.919s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d696cc7-7d34-444f-9017-073ab23bef3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0f0e92-69d0-46f8-bb1d-52b8cb72dca8]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:43 devstack sudo[105848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a
Jul 09 09:23:43 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:43 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e" returned: 0 in 0.688s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353ceee0-02f1-4daa-a0dd-b3ff81ea6b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13895bf9-d08f-4f21-8395-afffb220687e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f625d7f-4fa9-4e81-b5d5-0f2be59724ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:43 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Volume volume-13895bf9-d08f-4f21-8395-afffb220687e (13895bf9-d08f-4f21-8395-afffb220687e): created successfully
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f625d7f-4fa9-4e81-b5d5-0f2be59724ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Flow 'volume_create_manager' (538ccf17-b353-41a5-91ac-408a6bce9407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:43 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-1089792a-a811-426d-904e-c2f5657ec36e tempest-ProjectReaderTests-1932699243 None] Created volume successfully.
Jul 09 09:23:43 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-706e561b-ca4d-4379-b95e-44b127e1466e" returned: 0 in 0.810s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-quobyte-706e561b-ca4d-4379-b95e-44b127e1466e" released by "delete_volume" :: held 1.864s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Created reservations ['a8d07eba-ea5c-48c5-bcc6-0b08efe3da9c', '0487bc27-55b3-43aa-ac16-3c1668b0a888', '4ebfe78e-0c0c-49e8-821e-3c30c5423595', '4fce8b97-12e4-4640-9b96-e9fbb2b32785'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:44 devstack sudo[105852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:23:44 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "cinder-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] Creating offline snapshot 5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae of volume 13895bf9-d08f-4f21-8395-afffb220687e {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:44 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d821ad99-e355-4fd1-9d94-17fa1345be95]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a" returned: 0 in 0.954s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "cinder-quobyte-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-quobyte-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14" acquired by "delete_volume" :: waited 0.031s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:44 devstack sudo[105858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9
Jul 09 09:23:44 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cb3131-cd32-4ecf-8524-592293f89466]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:44 devstack sudo[105857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e
Jul 09 09:23:44 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:44 devstack sudo[105860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14
Jul 09 09:23:44 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:45 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.000s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:45 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:23:45 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Deleted volume successfully.
Jul 09 09:23:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-2ad8447d-2927-4fac-ba16-bc61fed724a4 tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-706e561b-ca4d-4379-b95e-44b127e1466e-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:45 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e" returned: 0 in 0.992s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:45 devstack sudo[105874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae 1G
Jul 09 09:23:45 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:45 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14" returned: 0 in 0.916s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:45 devstack sudo[105876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14
Jul 09 09:23:45 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:45 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9" returned: 0 in 1.091s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:45 devstack sudo[105878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9
Jul 09 09:23:45 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:46 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae 1G" returned: 0 in 0.850s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13895bf9-d08f-4f21-8395-afffb220687e -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:46 devstack sudo[105889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13895bf9-d08f-4f21-8395-afffb220687e -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae
Jul 09 09:23:46 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:46 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14" returned: 0 in 0.824s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:46 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-quobyte-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14" released by "delete_volume" :: held 1.816s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a.85478870-63fa-47c8-b711-56e65bc995f9" returned: 0 in 0.776s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-85478870-63fa-47c8-b711-56e65bc995f9" released by "_delete_snapshot" :: held 3.883s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-9d696cc7-7d34-444f-9017-073ab23bef3a" released by "delete_snapshot" :: held 3.927s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Created reservations ['7f105912-7d81-4020-a37f-8f77e06dfcfc', 'c3b99451-ca9a-45e3-bb47-cb028f41cac1', 'd2b153b4-4ac3-44f1-a1c0-fc67a2ee29ad', 'f52cf20e-e419-4e35-8932-b7ba21cd3ea3'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Created reservations ['dba017b6-2a7e-4b63-9078-ef88052b9bc1', 'a97233da-0cac-477a-b052-b3a4308f3aeb', '23b02fcd-c25c-490f-94d9-959eed4c561e', '17fe67a2-a521-4dee-a620-3d376b4e8f0c'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:46 devstack sudo[105891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:23:46 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:46 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Delete snapshot completed successfully.
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c9acbf75-e21c-4721-99d4-3919844d7f5d tempest-ProjectMemberTests-1928387478 None] Lock "cinder-85478870-63fa-47c8-b711-56e65bc995f9-delete_snapshot" released by "delete_snapshot" :: held 4.267s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-9d696cc7-7d34-444f-9017-073ab23bef3a-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-9d696cc7-7d34-444f-9017-073ab23bef3a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-9d696cc7-7d34-444f-9017-073ab23bef3a" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:47 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-9d696cc7-7d34-444f-9017-073ab23bef3a" acquired by "delete_volume" :: waited 0.032s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:47 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d5c6bf-0c3a-4c98-abc2-b6eedfa82d16]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:47 devstack sudo[105893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a
Jul 09 09:23:47 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:47 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13895bf9-d08f-4f21-8395-afffb220687e -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae" returned: 0 in 1.089s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:47 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae is being set with open permissions: ugo+rw
Jul 09 09:23:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:47 devstack sudo[105898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae
Jul 09 09:23:47 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:47 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.083s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:47 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:23:47 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Deleted volume successfully.
Jul 09 09:23:47 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7b48ead2-4f36-4af1-bc20-1ee3569707bf tempest-SnapshotDependencyTests-1953880461 None] Lock "cinder-fcb6c4af-4cbb-43f5-8bc9-e20bc563ab14-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:48 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a" returned: 0 in 1.124s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:48 devstack sudo[105904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a
Jul 09 09:23:48 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:48 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae" returned: 0 in 0.999s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:48 devstack sudo[105907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.info
Jul 09 09:23:48 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:48 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9d696cc7-7d34-444f-9017-073ab23bef3a" returned: 0 in 0.757s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:49 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-9d696cc7-7d34-444f-9017-073ab23bef3a" released by "delete_volume" :: held 1.982s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:49 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Created reservations ['bb802b9d-a2b9-49b0-a8e3-eb0f9bde1728', '1a9f45d3-94bd-4bc3-b669-59fa6fa9bcc5', '3f000259-651d-4cfa-b76e-c13760871172', 'e870d415-6b2c-45a0-bdf6-ad0945fb56fd'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:49 devstack sudo[105912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:23:49 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:49 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.info" returned: 0 in 0.826s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:49 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.info is being set with open permissions: ugo+rw
Jul 09 09:23:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:49 devstack sudo[105914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.info
Jul 09 09:23:49 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:50 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.785s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:23:50 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Deleted volume successfully.
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-fa701ae3-ecfb-4bc3-9652-3f4646887011 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-9d696cc7-7d34-444f-9017-073ab23bef3a-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:50 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.info" returned: 0 in 0.774s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.685s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:50 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-df13a3de-404a-4785-a49e-0e40218f85d6 tempest-ProjectReaderTests-1932699243 None] Create snapshot completed successfully
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Flow 'volume_create_manager' (4a409364-e5ac-49f7-9d15-4d5a09dbb4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e974a6c5-16c3-417c-9edd-16207ee4bf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e974a6c5-16c3-417c-9edd-16207ee4bf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1471137905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eba39a0-0197-4d2d-9c9a-16992dbf4665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afcfd1f14ed74ec2b19973c3c93516ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:50Z,use_quota=True,user_id='6deac2efc82a4184a5d2ea12bda178b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5edb4b-2cf9-4be0-a438-1837c7f2c6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5edb4b-2cf9-4be0-a438-1837c7f2c6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2837ebd0-21e1-44a4-91bd-29a69b696b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2837ebd0-21e1-44a4-91bd-29a69b696b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eba39a0-0197-4d2d-9c9a-16992dbf4665', 'volume_name': 'volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3f4d13-3c12-48e9-bd41-742b86fa4801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3f4d13-3c12-48e9-bd41-742b86fa4801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6757dffc-a916-4a34-8599-50ee213f7b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:50 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Volume 4eba39a0-0197-4d2d-9c9a-16992dbf4665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665', 'volume_size': 1}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1471137905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eba39a0-0197-4d2d-9c9a-16992dbf4665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afcfd1f14ed74ec2b19973c3c93516ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:50Z,use_quota=True,user_id='6deac2efc82a4184a5d2ea12bda178b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Creating volume 4eba39a0-0197-4d2d-9c9a-16992dbf4665 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:23:50 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:23:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:50 devstack sudo[105919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665 1073741824
Jul 09 09:23:50 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (16c12034-754a-4d97-9004-9d62ae3d146d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d833f28-bcd9-4850-a1ee-5d5f8a1f994d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-13895bf9-d08f-4f21-8395-afffb220687e" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d833f28-bcd9-4850-a1ee-5d5f8a1f994d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492772670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3191ab-7537-4742-8877-eee142065b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:51Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645851ba-cf44-4be8-b7c5-ceea8c4b7f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645851ba-cf44-4be8-b7c5-ceea8c4b7f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9834c2cc-0e1c-42aa-8f65-3b8bfbea3035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9834c2cc-0e1c-42aa-8f65-3b8bfbea3035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3191ab-7537-4742-8877-eee142065b54', 'volume_name': 'volume-ee3191ab-7537-4742-8877-eee142065b54', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5d3203-4af5-46d2-a90d-dc44be9fc1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5d3203-4af5-46d2-a90d-dc44be9fc1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86ae31f-90e0-4a05-956e-f0508dfccb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:51 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Volume ee3191ab-7537-4742-8877-eee142065b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3191ab-7537-4742-8877-eee142065b54', 'volume_size': 1}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-13895bf9-d08f-4f21-8395-afffb220687e" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Deleting offline snapshot 5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae of volume 13895bf9-d08f-4f21-8395-afffb220687e {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] snapshot_file for this snap is: volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d76c166-8a83-4056-b5ce-a8dfddc9ead3]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:51 devstack sudo[105921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae
Jul 09 09:23:51 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:51 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665 1073741824" returned: 0 in 1.104s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:51 devstack sudo[105928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665
Jul 09 09:23:51 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:52 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae" returned: 0 in 0.862s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13895bf9-d08f-4f21-8395-afffb220687e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ff3da5-1b1d-43b8-8727-2a3bc3e471fb]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:52 devstack sudo[105933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e
Jul 09 09:23:52 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:52 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665" returned: 0 in 0.686s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.255s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492772670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3191ab-7537-4742-8877-eee142065b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:51Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Creating volume ee3191ab-7537-4742-8877-eee142065b54 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:23:52 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6757dffc-a916-4a34-8599-50ee213f7b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af48eac8-3442-46df-9fb2-f4942d7ef19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:52 devstack sudo[105936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54 1073741824
Jul 09 09:23:52 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:52 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Volume volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665 (4eba39a0-0197-4d2d-9c9a-16992dbf4665): created successfully
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af48eac8-3442-46df-9fb2-f4942d7ef19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Flow 'volume_create_manager' (4a409364-e5ac-49f7-9d15-4d5a09dbb4f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:52 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-fc5d43c0-84c1-4ed5-8e68-4969dd4e4092 tempest-ProjectReaderTests-796618935 None] Created volume successfully.
Jul 09 09:23:52 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e" returned: 0 in 0.880s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:53 devstack sudo[105941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae
Jul 09 09:23:53 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:53 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54 1073741824" returned: 0 in 0.942s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:53 devstack sudo[105948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54
Jul 09 09:23:53 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Acquiring lock "cinder-4eba39a0-0197-4d2d-9c9a-16992dbf4665-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Lock "cinder-4eba39a0-0197-4d2d-9c9a-16992dbf4665-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:53 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae" returned: 0 in 0.936s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Acquiring lock "cinder-quobyte-4eba39a0-0197-4d2d-9c9a-16992dbf4665" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:53 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae
Jul 09 09:23:53 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:53 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Lock "cinder-quobyte-4eba39a0-0197-4d2d-9c9a-16992dbf4665" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:53 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0378f7-1476-47f9-ad0e-e94f7f907c28]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:54 devstack sudo[105955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665
Jul 09 09:23:54 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:54 devstack sudo[105957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:23:54 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:54 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54" returned: 0 in 0.857s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86ae31f-90e0-4a05-956e-f0508dfccb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3191ab-7537-4742-8877-eee142065b54', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74320191-a984-448c-9c5d-f42d5da29fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:54 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Volume volume-ee3191ab-7537-4742-8877-eee142065b54 (ee3191ab-7537-4742-8877-eee142065b54): created successfully
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74320191-a984-448c-9c5d-f42d5da29fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (16c12034-754a-4d97-9004-9d62ae3d146d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:54 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-db10e2f1-dcac-4c91-b379-0d7ec907eaf6 tempest-ProjectMemberTests-1928387478 None] Created volume successfully.
Jul 09 09:23:54 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e.5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae" returned: 0 in 0.807s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae" released by "_delete_snapshot" :: held 3.624s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-13895bf9-d08f-4f21-8395-afffb220687e" released by "delete_snapshot" :: held 3.657s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Created reservations ['5e657a65-5a85-4ad2-819c-c0c7c9e6bb59', '542fa626-ad62-44e9-a984-bb5de8bf7bea', 'b4b6dba4-945f-4836-971c-5c86ac9ed90f', '122b140a-08e2-4e27-bcb6-ccfdb3ef17df'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:54 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Delete snapshot completed successfully.
Jul 09 09:23:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-e78e8d35-ecd8-462b-a340-0f3eff6210b1 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-5c3f3b18-fa3a-4aa4-a36c-023b6b3f6dae-delete_snapshot" released by "delete_snapshot" :: held 3.895s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:55 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.922s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 28 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:23:55 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665" returned: 0 in 1.190s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:55 devstack sudo[105965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665
Jul 09 09:23:55 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-13895bf9-d08f-4f21-8395-afffb220687e-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Lock "cinder-13895bf9-d08f-4f21-8395-afffb220687e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-13895bf9-d08f-4f21-8395-afffb220687e" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-13895bf9-d08f-4f21-8395-afffb220687e" acquired by "delete_volume" :: waited 0.028s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfdcdcd-d692-463d-845e-dfee7c9b9446]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] Creating offline snapshot 2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7 of volume ee3191ab-7537-4742-8877-eee142065b54 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef77a06-7534-4cda-b4d3-8829feba1866]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:23:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:55 devstack sudo[105967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e
Jul 09 09:23:55 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:55 devstack sudo[105968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54
Jul 09 09:23:55 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:56 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4eba39a0-0197-4d2d-9c9a-16992dbf4665" returned: 0 in 0.840s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:56 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Lock "cinder-quobyte-4eba39a0-0197-4d2d-9c9a-16992dbf4665" released by "delete_volume" :: held 2.085s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:56 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Created reservations ['574b7169-81f3-420e-bd9a-bef20d779ffa', 'a006729c-7d96-4958-b32a-e9daafdd372e', '8daaa4ea-5688-4105-a3b0-8c9ad1d614b0', '8280e2bf-429c-46ff-868a-9d2c6b130ecc'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:56 devstack sudo[105974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:23:56 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:56 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e" returned: 0 in 0.885s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:56 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e
Jul 09 09:23:56 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:56 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54" returned: 0 in 1.007s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:56 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7 1G
Jul 09 09:23:56 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:57 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.835s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:57 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:23:57 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Deleted volume successfully.
Jul 09 09:23:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-a0edd7d7-9a0e-42fd-9e60-ece1a81e2f44 tempest-ProjectReaderTests-796618935 None] Lock "cinder-4eba39a0-0197-4d2d-9c9a-16992dbf4665-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:57 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-13895bf9-d08f-4f21-8395-afffb220687e" returned: 0 in 0.801s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:57 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-13895bf9-d08f-4f21-8395-afffb220687e" released by "delete_volume" :: held 1.773s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:57 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Created reservations ['1d0ec3a7-615f-4573-9358-27badcf6816e', 'fc1a7685-7057-4e8e-915a-dccc5fef4df4', '8f82b00c-095a-4fb3-97c2-ea1f8fcfe266', '931bf1ad-862c-48ae-b267-7db4569fd1d3'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:23:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:23:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:23:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:23:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:23:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:57 devstack sudo[105991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:23:57 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:57 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7 1G" returned: 0 in 0.990s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3191ab-7537-4742-8877-eee142065b54 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:57 devstack sudo[105993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3191ab-7537-4742-8877-eee142065b54 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7
Jul 09 09:23:57 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Flow 'volume_create_manager' (312e0fd7-e50e-4870-9c74-3a81a33aea2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d90a31-df05-43bd-9479-b8f4e862dc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d90a31-df05-43bd-9479-b8f4e862dc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599311515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984d460f-03af-4093-b045-cdca5ccce2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afcfd1f14ed74ec2b19973c3c93516ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:58Z,use_quota=True,user_id='6deac2efc82a4184a5d2ea12bda178b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710b2dd0-ce86-4e9e-ba79-6eb786ff235d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710b2dd0-ce86-4e9e-ba79-6eb786ff235d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55bb238-5e44-4552-83a5-06f11e50066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55bb238-5e44-4552-83a5-06f11e50066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '984d460f-03af-4093-b045-cdca5ccce2f6', 'volume_name': 'volume-984d460f-03af-4093-b045-cdca5ccce2f6', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91edabfb-f147-4942-89ca-dfedadef79df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91edabfb-f147-4942-89ca-dfedadef79df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b06f87-fe05-4f1e-bfde-f26253fcf409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:58 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Volume 984d460f-03af-4093-b045-cdca5ccce2f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-984d460f-03af-4093-b045-cdca5ccce2f6', 'volume_size': 1}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:23:58 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Flow 'volume_create_manager' (2afa95f0-fd34-46b6-b22b-bf4609a38a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0071f69c-00d4-452e-8673-c1bd218d27ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 1.045s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:23:58 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Deleted volume successfully.
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0071f69c-00d4-452e-8673-c1bd218d27ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599343213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c09cc83-2fcb-41ce-af9a-b4d90babfff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6f656845904aa9b49ee5780aa968f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:58Z,use_quota=True,user_id='6d65a947fd8749069630184a47b0df8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8252c3b-9381-4453-95c9-79d39e890f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8252c3b-9381-4453-95c9-79d39e890f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02369f48-3956-41e4-bf7d-26ec96f8ad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02369f48-3956-41e4-bf7d-26ec96f8ad58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c09cc83-2fcb-41ce-af9a-b4d90babfff1', 'volume_name': 'volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2336a267-b584-4ffe-ae2d-47a5d3be16dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2336a267-b584-4ffe-ae2d-47a5d3be16dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22059b5f-0a24-4b3a-a560-84a36f77091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:23:58 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Volume 4c09cc83-2fcb-41ce-af9a-b4d90babfff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1', 'volume_size': 1}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3b319d15-7c46-4d54-b40a-9540701a29cd tempest-ProjectReaderTests-1932699243 None] Lock "cinder-13895bf9-d08f-4f21-8395-afffb220687e-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:23:58 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3191ab-7537-4742-8877-eee142065b54 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7" returned: 0 in 1.010s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:58 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7 is being set with open permissions: ugo+rw
Jul 09 09:23:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:58 devstack sudo[105999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7
Jul 09 09:23:58 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:59 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7" returned: 0 in 0.647s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:59 devstack sudo[106002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.info
Jul 09 09:23:59 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:23:59 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root
Jul 09 09:23:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.info" returned: 0 in 0.635s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:23:59 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.info is being set with open permissions: ugo+rw
Jul 09 09:23:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:23:59 devstack sudo[106006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.info
Jul 09 09:23:59 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:00 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.info" returned: 0 in 0.631s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.043s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.462s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599311515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984d460f-03af-4093-b045-cdca5ccce2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afcfd1f14ed74ec2b19973c3c93516ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:58Z,use_quota=True,user_id='6deac2efc82a4184a5d2ea12bda178b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:24:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Creating volume 984d460f-03af-4093-b045-cdca5ccce2f6 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:24:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:00 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:24:00 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:24:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-984d460f-03af-4093-b045-cdca5ccce2f6 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:00 devstack sudo[106009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-984d460f-03af-4093-b045-cdca5ccce2f6 1073741824
Jul 09 09:24:00 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:00 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-4aaad08c-45bb-40d3-b98e-b47a5932f790 tempest-ProjectMemberTests-1928387478 None] Create snapshot completed successfully
Jul 09 09:24:01 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-984d460f-03af-4093-b045-cdca5ccce2f6 1073741824" returned: 0 in 0.797s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-984d460f-03af-4093-b045-cdca5ccce2f6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:01 devstack sudo[106017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-984d460f-03af-4093-b045-cdca5ccce2f6
Jul 09 09:24:01 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-ee3191ab-7537-4742-8877-eee142065b54" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-ee3191ab-7537-4742-8877-eee142065b54" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Deleting offline snapshot 2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7 of volume ee3191ab-7537-4742-8877-eee142065b54 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:24:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] snapshot_file for this snap is: volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:24:01 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b93dca-4468-41f2-9224-156016da8d79]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:01 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7
Jul 09 09:24:01 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:02 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-984d460f-03af-4093-b045-cdca5ccce2f6" returned: 0 in 0.673s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.615s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599343213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c09cc83-2fcb-41ce-af9a-b4d90babfff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6f656845904aa9b49ee5780aa968f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:23:58Z,use_quota=True,user_id='6d65a947fd8749069630184a47b0df8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Creating volume 4c09cc83-2fcb-41ce-af9a-b4d90babfff1 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:24:02 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:02 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1 1073741824
Jul 09 09:24:02 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b06f87-fe05-4f1e-bfde-f26253fcf409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984d460f-03af-4093-b045-cdca5ccce2f6', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16a3248-cb54-4409-b060-ebdb53dcce8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:02 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Volume volume-984d460f-03af-4093-b045-cdca5ccce2f6 (984d460f-03af-4093-b045-cdca5ccce2f6): created successfully
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16a3248-cb54-4409-b060-ebdb53dcce8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Flow 'volume_create_manager' (312e0fd7-e50e-4870-9c74-3a81a33aea2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:02 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-91251484-7d84-43a9-8be9-50c2af8d96a9 tempest-ProjectReaderTests-796618935 None] Created volume successfully.
Jul 09 09:24:02 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7" returned: 0 in 0.817s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee3191ab-7537-4742-8877-eee142065b54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[651f3623-e620-46e5-8d90-f9e19d05a541]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:02 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54
Jul 09 09:24:02 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:02 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1 1073741824" returned: 0 in 0.818s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:02 devstack sudo[106032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1
Jul 09 09:24:02 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Acquiring lock "cinder-984d460f-03af-4093-b045-cdca5ccce2f6-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Lock "cinder-984d460f-03af-4093-b045-cdca5ccce2f6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Acquiring lock "cinder-quobyte-984d460f-03af-4093-b045-cdca5ccce2f6" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Lock "cinder-quobyte-984d460f-03af-4093-b045-cdca5ccce2f6" acquired by "delete_volume" :: waited 0.023s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db52dd6-e495-4239-ba47-ebd9d3b82af3]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-984d460f-03af-4093-b045-cdca5ccce2f6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:03 devstack sudo[106034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-984d460f-03af-4093-b045-cdca5ccce2f6
Jul 09 09:24:03 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:03 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54" returned: 0 in 0.852s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:03 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7
Jul 09 09:24:03 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:03 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1" returned: 0 in 0.684s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22059b5f-0a24-4b3a-a560-84a36f77091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27dba907-94f5-4e00-a043-3f6a02ed7326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:03 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Volume volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1 (4c09cc83-2fcb-41ce-af9a-b4d90babfff1): created successfully
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27dba907-94f5-4e00-a043-3f6a02ed7326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:03 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Flow 'volume_create_manager' (2afa95f0-fd34-46b6-b22b-bf4609a38a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:03 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-20ad4dbc-0174-4032-a838-64283ba0412a tempest-ProjectReaderTests-1932699243 None] Created volume successfully.
Jul 09 09:24:04 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-984d460f-03af-4093-b045-cdca5ccce2f6" returned: 0 in 0.832s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-984d460f-03af-4093-b045-cdca5ccce2f6 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:04 devstack sudo[106048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-984d460f-03af-4093-b045-cdca5ccce2f6
Jul 09 09:24:04 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:04 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7" returned: 0 in 0.747s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:04 devstack sudo[106050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7
Jul 09 09:24:04 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:04 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-984d460f-03af-4093-b045-cdca5ccce2f6" returned: 0 in 0.696s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:04 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Lock "cinder-quobyte-984d460f-03af-4093-b045-cdca5ccce2f6" released by "delete_volume" :: held 1.592s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:04 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] Creating offline snapshot 1144403a-49d5-427e-b6b6-8d017a8e08a9 of volume 4c09cc83-2fcb-41ce-af9a-b4d90babfff1 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:24:04 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b46f53-c9d8-43e8-a3c8-2aca2eaca7f6]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:04 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Created reservations ['5a025396-32c4-4a33-8b6e-eab89978d74d', '63006acc-7833-4be9-bb56-bd32a8f8cc5c', 'd07027bb-e5c7-46c2-b41b-e59219b30063', '2a6024ba-2524-4568-be12-53219720119b'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:05 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54.2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7" returned: 0 in 0.692s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7" released by "_delete_snapshot" :: held 3.206s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-ee3191ab-7537-4742-8877-eee142065b54" released by "delete_snapshot" :: held 3.237s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:05 devstack sudo[106054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1
Jul 09 09:24:05 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:05 devstack sudo[106056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:24:05 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Created reservations ['647cdd71-11ca-4eb3-9011-2b28ca106734', '3233f5b4-f24d-4510-bbc1-8e65968a7b28', '499372ec-e500-4835-874e-c7f60bd0a99f', '9c34043c-c6a2-4fd6-806c-72774cac7ca1'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:05 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Delete snapshot completed successfully.
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-cd12ea03-a178-4b31-b4f0-28d3e434e481 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-2bfb42e1-6f2a-4c00-ab0c-8c84fa8a1ad7-delete_snapshot" released by "delete_snapshot" :: held 3.428s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:05 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1" returned: 0 in 0.830s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:05 devstack sudo[106063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9 1G
Jul 09 09:24:05 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:05 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.720s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:24:05 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Deleted volume successfully.
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8cb539d3-05eb-4b0e-8ac5-ceefbfdda891 tempest-ProjectReaderTests-796618935 None] Lock "cinder-984d460f-03af-4093-b045-cdca5ccce2f6-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:05 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Flow 'volume_create_manager' (cedfbcca-6b61-4eb4-a129-6c99de470858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f681251-5a9d-40f0-92fc-f513c6419a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-ee3191ab-7537-4742-8877-eee142065b54-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f681251-5a9d-40f0-92fc-f513c6419a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840385689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2c6ed5-4e59-4601-9de3-d19afb51de28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afcfd1f14ed74ec2b19973c3c93516ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:06Z,use_quota=True,user_id='6deac2efc82a4184a5d2ea12bda178b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20daeaf-087f-4ac1-b504-6461397b822b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20daeaf-087f-4ac1-b504-6461397b822b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea75191-2801-482a-86eb-6f8a610d4cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea75191-2801-482a-86eb-6f8a610d4cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c2c6ed5-4e59-4601-9de3-d19afb51de28', 'volume_name': 'volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433e5e97-be5c-418d-9e01-8947f574b0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (433e5e97-be5c-418d-9e01-8947f574b0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78729bb-6b43-482c-950c-1f7533765ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:06 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Volume 5c2c6ed5-4e59-4601-9de3-d19afb51de28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28', 'volume_size': 1}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-ee3191ab-7537-4742-8877-eee142065b54-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-ee3191ab-7537-4742-8877-eee142065b54" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-ee3191ab-7537-4742-8877-eee142065b54" acquired by "delete_volume" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3a93e5-580a-4fe9-bc37-7c85ae15dd06]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:06 devstack sudo[106065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54
Jul 09 09:24:06 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:06 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9 1G" returned: 0 in 0.861s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:06 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:06 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9
Jul 09 09:24:06 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:07 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54" returned: 0 in 0.824s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:07 devstack sudo[106075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54
Jul 09 09:24:07 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:07 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9" returned: 0 in 0.714s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:07 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9 is being set with open permissions: ugo+rw
Jul 09 09:24:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:07 devstack sudo[106080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9
Jul 09 09:24:07 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:07 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-ee3191ab-7537-4742-8877-eee142065b54" returned: 0 in 0.684s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-ee3191ab-7537-4742-8877-eee142065b54" released by "delete_volume" :: held 1.572s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:07 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Created reservations ['6232863c-0acf-4e1c-aa1d-efbdbe516062', '74cab574-cfa2-4f9e-86f0-57c9a9d8204a', '981f7e1b-cd62-412c-b389-babb488485bb', '903c0a27-5b33-4b7a-8009-944ea65fb0d3'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:07 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:07 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:24:07 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:08 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9" returned: 0 in 0.662s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:08 devstack sudo[106086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.info
Jul 09 09:24:08 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:08 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.741s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:24:08 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Deleted volume successfully.
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d4e2a370-96e8-43e6-b75c-092d33c6e634 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-ee3191ab-7537-4742-8877-eee142065b54-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:08 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.info" returned: 0 in 0.692s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:08 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.info is being set with open permissions: ugo+rw
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:24:08 devstack sudo[106090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.info
Jul 09 09:24:08 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (f0c31034-29f9-4bde-9fdc-f6f95c5595f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d024e126-8f33-4b46-ab15-b9d3271887d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d024e126-8f33-4b46-ab15-b9d3271887d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802982419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff1baff-2456-46d4-9089-a18607f25acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:09Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab39c82-3609-4342-b68b-72d239b8d1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab39c82-3609-4342-b68b-72d239b8d1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b40c156-95b8-4fbd-b11f-748cb820df86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b40c156-95b8-4fbd-b11f-748cb820df86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff1baff-2456-46d4-9089-a18607f25acb', 'volume_name': 'volume-9ff1baff-2456-46d4-9089-a18607f25acb', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060191d3-864d-4917-98f8-d315003da987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060191d3-864d-4917-98f8-d315003da987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ade240-9d69-44d0-9ef5-e16c4a34bae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:08 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Volume 9ff1baff-2456-46d4-9089-a18607f25acb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff1baff-2456-46d4-9089-a18607f25acb', 'volume_size': 1}
Jul 09 09:24:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:09 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.info" returned: 0 in 0.631s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.485s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.283s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840385689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2c6ed5-4e59-4601-9de3-d19afb51de28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afcfd1f14ed74ec2b19973c3c93516ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:06Z,use_quota=True,user_id='6deac2efc82a4184a5d2ea12bda178b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:24:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Creating volume 5c2c6ed5-4e59-4601-9de3-d19afb51de28 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:24:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:09 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:24:09 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:24:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:09 devstack sudo[106093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28 1073741824
Jul 09 09:24:09 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:09 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-55c8f267-e754-4251-abe4-c1621cba34c8 tempest-ProjectReaderTests-1932699243 None] Create snapshot completed successfully
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-1144403a-49d5-427e-b6b6-8d017a8e08a9-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-1144403a-49d5-427e-b6b6-8d017a8e08a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-4c09cc83-2fcb-41ce-af9a-b4d90babfff1" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-4c09cc83-2fcb-41ce-af9a-b4d90babfff1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-1144403a-49d5-427e-b6b6-8d017a8e08a9" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-1144403a-49d5-427e-b6b6-8d017a8e08a9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Deleting offline snapshot 1144403a-49d5-427e-b6b6-8d017a8e08a9 of volume 4c09cc83-2fcb-41ce-af9a-b4d90babfff1 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] snapshot_file for this snap is: volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[837f3779-0b67-418c-9693-554af9d6f683]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:10 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28 1073741824" returned: 0 in 0.815s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:10 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28
Jul 09 09:24:10 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:10 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9
Jul 09 09:24:10 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:10 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28" returned: 0 in 0.633s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.041s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802982419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff1baff-2456-46d4-9089-a18607f25acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:09Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Creating volume 9ff1baff-2456-46d4-9089-a18607f25acb {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:24:10 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:10 devstack sudo[106108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb 1073741824
Jul 09 09:24:10 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78729bb-6b43-482c-950c-1f7533765ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bfd770-1404-402e-927e-1219ddc99763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:10 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Volume volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28 (5c2c6ed5-4e59-4601-9de3-d19afb51de28): created successfully
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bfd770-1404-402e-927e-1219ddc99763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:10 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Flow 'volume_create_manager' (cedfbcca-6b61-4eb4-a129-6c99de470858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9" returned: 0 in 0.764s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:24:10 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-391a3ad4-dfe8-4bfe-88ca-3044b090c1ec tempest-ProjectReaderTests-796618935 None] Created volume successfully.
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7bd10b-a15c-4888-858d-474505184351]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:10 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:11 devstack sudo[106110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1
Jul 09 09:24:11 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Acquiring lock "cinder-5c2c6ed5-4e59-4601-9de3-d19afb51de28-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Lock "cinder-5c2c6ed5-4e59-4601-9de3-d19afb51de28-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Acquiring lock "cinder-quobyte-5c2c6ed5-4e59-4601-9de3-d19afb51de28" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:11 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Lock "cinder-quobyte-5c2c6ed5-4e59-4601-9de3-d19afb51de28" acquired by "delete_volume" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:11 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8f6a8a-52b6-4275-8428-f058338d3df3]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:11 devstack sudo[106115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28
Jul 09 09:24:11 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:11 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb 1073741824" returned: 0 in 0.835s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:11 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1" returned: 0 in 0.802s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:11 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:11 devstack sudo[106121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb
Jul 09 09:24:11 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:11 devstack sudo[106123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9
Jul 09 09:24:11 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:12 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28" returned: 0 in 0.842s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:12 devstack sudo[106130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28
Jul 09 09:24:12 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:12 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb" returned: 0 in 0.665s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:12 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:24:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ade240-9d69-44d0-9ef5-e16c4a34bae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff1baff-2456-46d4-9089-a18607f25acb', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae4e597-08d8-4b15-b792-41a2ec06b1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:12 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Volume volume-9ff1baff-2456-46d4-9089-a18607f25acb (9ff1baff-2456-46d4-9089-a18607f25acb): created successfully
Jul 09 09:24:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae4e597-08d8-4b15-b792-41a2ec06b1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:12 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (f0c31034-29f9-4bde-9fdc-f6f95c5595f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:12 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d646545c-0f93-4e6f-9afe-cd1b5609171b tempest-ProjectMemberTests-1928387478 None] Created volume successfully.
Jul 09 09:24:12 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9" returned: 0 in 0.788s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:12 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:12 devstack sudo[106135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9
Jul 09 09:24:12 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:13 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-5c2c6ed5-4e59-4601-9de3-d19afb51de28" returned: 0 in 0.685s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Lock "cinder-quobyte-5c2c6ed5-4e59-4601-9de3-d19afb51de28" released by "delete_volume" :: held 1.576s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] Creating offline snapshot b95250d0-2fe8-4cf6-9540-b5b3464e5fdc of volume 9ff1baff-2456-46d4-9089-a18607f25acb {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dfc494-7d2b-4060-8c59-8c17201312a6]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Created reservations ['6d79d5a9-3e72-483f-a72a-c0fe19c412ee', '34129562-c446-4b61-8ad7-1c9d271a4112', '96374f35-561b-4f62-9e69-fff65bba4b96', '6190fcb6-1295-47a0-9578-3634660806fa'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:13 devstack sudo[106138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb
Jul 09 09:24:13 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:13 devstack sudo[106140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:24:13 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:13 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1.1144403a-49d5-427e-b6b6-8d017a8e08a9" returned: 0 in 0.720s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-1144403a-49d5-427e-b6b6-8d017a8e08a9" released by "_delete_snapshot" :: held 3.190s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-4c09cc83-2fcb-41ce-af9a-b4d90babfff1" released by "delete_snapshot" :: held 3.220s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Created reservations ['c488f94f-b99f-4f3c-a46b-7c93e1f71e27', '13f89c97-fad6-4d1e-bfe9-567bad448fbe', '559b5b30-3dda-4300-a0c5-f06762288c80', '2701e875-5400-4130-bedb-6604fee77240'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Delete snapshot completed successfully.
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-326358ea-626e-4fde-a2f3-f9468fd3c9c5 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-1144403a-49d5-427e-b6b6-8d017a8e08a9-delete_snapshot" released by "delete_snapshot" :: held 3.386s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:13 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.709s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:24:13 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Deleted volume successfully.
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-d3160f79-b3cd-430d-840c-b859924a129f tempest-ProjectReaderTests-796618935 None] Lock "cinder-5c2c6ed5-4e59-4601-9de3-d19afb51de28-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:13 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb" returned: 0 in 0.879s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:13 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:14 devstack sudo[106147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc 1G
Jul 09 09:24:14 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Flow 'volume_create_manager' (ca3f5759-220f-4af4-b70d-212cf368694d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd35ae7-d054-4e18-b19a-0c4926ff709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd35ae7-d054-4e18-b19a-0c4926ff709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2000577460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335daca3-468a-4da1-999c-49f656fff648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afcfd1f14ed74ec2b19973c3c93516ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:14Z,use_quota=True,user_id='6deac2efc82a4184a5d2ea12bda178b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793683a6-65c6-4355-9650-f7b003200791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793683a6-65c6-4355-9650-f7b003200791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1372c27-2e61-40b3-b31c-94f5b3e8092e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1372c27-2e61-40b3-b31c-94f5b3e8092e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '335daca3-468a-4da1-999c-49f656fff648', 'volume_name': 'volume-335daca3-468a-4da1-999c-49f656fff648', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94804b2-ef22-4062-b4b2-4746829db876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94804b2-ef22-4062-b4b2-4746829db876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4c973c-0917-4f07-be35-22161ac4afac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:14 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Volume 335daca3-468a-4da1-999c-49f656fff648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-335daca3-468a-4da1-999c-49f656fff648', 'volume_size': 1}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-4c09cc83-2fcb-41ce-af9a-b4d90babfff1-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Lock "cinder-4c09cc83-2fcb-41ce-af9a-b4d90babfff1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-4c09cc83-2fcb-41ce-af9a-b4d90babfff1" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-4c09cc83-2fcb-41ce-af9a-b4d90babfff1" acquired by "delete_volume" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38db0d2-d847-444b-a049-2e528191009d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:14 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1
Jul 09 09:24:14 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:14 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc 1G" returned: 0 in 0.782s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:14 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff1baff-2456-46d4-9089-a18607f25acb -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:14 devstack sudo[106154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff1baff-2456-46d4-9089-a18607f25acb -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc
Jul 09 09:24:14 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:15 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1" returned: 0 in 0.766s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:15 devstack sudo[106159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1
Jul 09 09:24:15 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:15 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff1baff-2456-46d4-9089-a18607f25acb -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc" returned: 0 in 0.662s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:15 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc is being set with open permissions: ugo+rw
Jul 09 09:24:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:15 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc
Jul 09 09:24:15 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:15 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-4c09cc83-2fcb-41ce-af9a-b4d90babfff1" returned: 0 in 0.630s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:15 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-4c09cc83-2fcb-41ce-af9a-b4d90babfff1" released by "delete_volume" :: held 1.453s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:15 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Created reservations ['2c53e4ac-1dad-46bf-91eb-d7e1db4f56e8', '114f2354-28ce-4f28-922a-f35e1e8d8589', '70bf6be4-d174-4ea9-bfce-ed232c4c397e', '6a58cfac-456c-4d9d-a474-23a553c8820d'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:15 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:15 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:16 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:16 devstack sudo[106168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:24:16 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:16 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc" returned: 0 in 0.629s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:16 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.info
Jul 09 09:24:16 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:16 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.692s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:16 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:24:16 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Deleted volume successfully.
Jul 09 09:24:16 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.info" returned: 0 in 0.625s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:16 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.info is being set with open permissions: ugo+rw
Jul 09 09:24:16 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:16 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-289b2704-cd77-4d2f-a473-d6afc223848d tempest-ProjectReaderTests-1932699243 None] Lock "cinder-4c09cc83-2fcb-41ce-af9a-b4d90babfff1-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:16 devstack sudo[106174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.info
Jul 09 09:24:16 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Flow 'volume_create_manager' (bfd41a8c-8ce3-4440-98d8-160c4efe64e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8382ab60-1aeb-4749-ad11-5f26686c97be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8382ab60-1aeb-4749-ad11-5f26686c97be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1947378340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63a1441-cd44-43a7-9ac4-f4f4be657da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6f656845904aa9b49ee5780aa968f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:17Z,use_quota=True,user_id='6d65a947fd8749069630184a47b0df8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa40525b-6fb7-46bd-ad8d-fad406cb44f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa40525b-6fb7-46bd-ad8d-fad406cb44f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c6a13f-e503-4f46-9e72-ac08a5b3923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c6a13f-e503-4f46-9e72-ac08a5b3923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e63a1441-cd44-43a7-9ac4-f4f4be657da2', 'volume_name': 'volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3166341-734d-4af6-bb89-b6e2dddba3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3166341-734d-4af6-bb89-b6e2dddba3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63b6cad-b372-4d8d-9bfa-3cfc35a30591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:17 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Volume e63a1441-cd44-43a7-9ac4-f4f4be657da2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2', 'volume_size': 1}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:17 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.info" returned: 0 in 0.707s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.370s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.304s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2000577460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335daca3-468a-4da1-999c-49f656fff648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afcfd1f14ed74ec2b19973c3c93516ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:14Z,use_quota=True,user_id='6deac2efc82a4184a5d2ea12bda178b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Creating volume 335daca3-468a-4da1-999c-49f656fff648 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:24:17 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:24:17 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-335daca3-468a-4da1-999c-49f656fff648 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:17 devstack sudo[106177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-335daca3-468a-4da1-999c-49f656fff648 1073741824
Jul 09 09:24:17 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:17 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-4681b312-70b7-4efb-8945-f032ae713fc1 tempest-ProjectMemberTests-1928387478 None] Create snapshot completed successfully
Jul 09 09:24:18 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-335daca3-468a-4da1-999c-49f656fff648 1073741824" returned: 0 in 0.806s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-335daca3-468a-4da1-999c-49f656fff648 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-b95250d0-2fe8-4cf6-9540-b5b3464e5fdc-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:18 devstack sudo[106183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-335daca3-468a-4da1-999c-49f656fff648
Jul 09 09:24:18 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-b95250d0-2fe8-4cf6-9540-b5b3464e5fdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-9ff1baff-2456-46d4-9089-a18607f25acb" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-9ff1baff-2456-46d4-9089-a18607f25acb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-b95250d0-2fe8-4cf6-9540-b5b3464e5fdc" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-b95250d0-2fe8-4cf6-9540-b5b3464e5fdc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Deleting offline snapshot b95250d0-2fe8-4cf6-9540-b5b3464e5fdc of volume 9ff1baff-2456-46d4-9089-a18607f25acb {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] snapshot_file for this snap is: volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee869ee-a1f5-4592-a12f-07b04688cd31]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:18 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc
Jul 09 09:24:18 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:18 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-335daca3-468a-4da1-999c-49f656fff648" returned: 0 in 0.671s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.830s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1947378340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63a1441-cd44-43a7-9ac4-f4f4be657da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6f656845904aa9b49ee5780aa968f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:17Z,use_quota=True,user_id='6d65a947fd8749069630184a47b0df8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Creating volume e63a1441-cd44-43a7-9ac4-f4f4be657da2 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:24:18 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:24:18 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4c973c-0917-4f07-be35-22161ac4afac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-335daca3-468a-4da1-999c-49f656fff648', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:19 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2 1073741824
Jul 09 09:24:19 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29673e95-a97e-44a3-95fd-d765b6c4d0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:19 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Volume volume-335daca3-468a-4da1-999c-49f656fff648 (335daca3-468a-4da1-999c-49f656fff648): created successfully
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29673e95-a97e-44a3-95fd-d765b6c4d0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Flow 'volume_create_manager' (ca3f5759-220f-4af4-b70d-212cf368694d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:19 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d59e6493-48b1-4e8d-90f1-710b7aa0e06d tempest-ProjectReaderTests-796618935 None] Created volume successfully.
Jul 09 09:24:19 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc" returned: 0 in 0.853s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff1baff-2456-46d4-9089-a18607f25acb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f58ede-71ce-4c53-9f7b-dc881db072e6]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Acquiring lock "cinder-335daca3-468a-4da1-999c-49f656fff648-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Lock "cinder-335daca3-468a-4da1-999c-49f656fff648-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Acquiring lock "cinder-quobyte-335daca3-468a-4da1-999c-49f656fff648" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:19 devstack sudo[106193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb
Jul 09 09:24:19 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Lock "cinder-quobyte-335daca3-468a-4da1-999c-49f656fff648" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e3583f-b630-4791-8b9f-8262304ac51d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-335daca3-468a-4da1-999c-49f656fff648 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:19 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-335daca3-468a-4da1-999c-49f656fff648
Jul 09 09:24:19 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:19 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2 1073741824" returned: 0 in 0.890s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:19 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:19 devstack sudo[106202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2
Jul 09 09:24:19 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:20 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb" returned: 0 in 0.828s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:20 devstack sudo[106207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc
Jul 09 09:24:20 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:20 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-335daca3-468a-4da1-999c-49f656fff648" returned: 0 in 0.814s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-335daca3-468a-4da1-999c-49f656fff648 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:20 devstack sudo[106212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-335daca3-468a-4da1-999c-49f656fff648
Jul 09 09:24:20 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:20 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2" returned: 0 in 0.683s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63b6cad-b372-4d8d-9bfa-3cfc35a30591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a22838e-39bd-4a22-a1ec-da6058072bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:20 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Volume volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2 (e63a1441-cd44-43a7-9ac4-f4f4be657da2): created successfully
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a22838e-39bd-4a22-a1ec-da6058072bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Flow 'volume_create_manager' (bfd41a8c-8ce3-4440-98d8-160c4efe64e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:20 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-56b1c558-816c-4d0c-9270-0c68a3747928 tempest-ProjectReaderTests-1932699243 None] Created volume successfully.
Jul 09 09:24:20 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc" returned: 0 in 0.782s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:20 devstack sudo[106219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc
Jul 09 09:24:20 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:20 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-335daca3-468a-4da1-999c-49f656fff648" returned: 0 in 0.666s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:20 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Lock "cinder-quobyte-335daca3-468a-4da1-999c-49f656fff648" released by "delete_volume" :: held 1.524s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Created reservations ['08578384-1449-46a7-b619-35d6925c1db3', 'f3ce826d-d4f2-462d-8a46-47776666a48c', '9318bb92-3d6e-4705-951e-9dfdeaa1d50f', '3d202f28-e8c9-472e-a722-63d2c61a6160'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:21 devstack sudo[106221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:24:21 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] Creating offline snapshot e085a88f-3e8c-4bb1-8026-8b9e9e977e8b of volume e63a1441-cd44-43a7-9ac4-f4f4be657da2 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb71d254-357d-45e1-b876-a2ec275d4a0b]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:21 devstack sudo[106223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2
Jul 09 09:24:21 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:21 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb.b95250d0-2fe8-4cf6-9540-b5b3464e5fdc" returned: 0 in 0.729s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-b95250d0-2fe8-4cf6-9540-b5b3464e5fdc" released by "_delete_snapshot" :: held 3.306s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-9ff1baff-2456-46d4-9089-a18607f25acb" released by "delete_snapshot" :: held 3.334s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Created reservations ['096874a7-2a4c-4c06-a0af-4be65d52c9cd', '4c2f63ac-5f80-4d6a-abaf-43b2ee531373', '1e91cda1-427e-4779-9ee6-5929ccfd7322', '1b24e9a6-293d-4313-9898-d1244ced07aa'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:21 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.705s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:24:21 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Deleted volume successfully.
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-85303af5-abd8-4c8f-9d9a-dcc890d88adf tempest-ProjectReaderTests-796618935 None] Lock "cinder-335daca3-468a-4da1-999c-49f656fff648-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:21 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Delete snapshot completed successfully.
Jul 09 09:24:21 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-944ce8c7-638d-46e0-9a91-ad4adf73bd33 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-b95250d0-2fe8-4cf6-9540-b5b3464e5fdc-delete_snapshot" released by "delete_snapshot" :: held 3.527s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:22 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2" returned: 0 in 0.873s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:22 devstack sudo[106231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b 1G
Jul 09 09:24:22 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-9ff1baff-2456-46d4-9089-a18607f25acb-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-9ff1baff-2456-46d4-9089-a18607f25acb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-9ff1baff-2456-46d4-9089-a18607f25acb" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:22 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-9ff1baff-2456-46d4-9089-a18607f25acb" acquired by "delete_volume" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:22 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd649843-974a-43b9-a378-cc9851bb099d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:22 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:22 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb
Jul 09 09:24:22 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:23 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b 1G" returned: 0 in 0.894s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:23 devstack sudo[106240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b
Jul 09 09:24:23 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:23 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb" returned: 0 in 0.855s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:23 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb
Jul 09 09:24:23 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:23 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b" returned: 0 in 0.780s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:23 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b is being set with open permissions: ugo+rw
Jul 09 09:24:23 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:24 devstack sudo[106251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b
Jul 09 09:24:24 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:24 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-9ff1baff-2456-46d4-9089-a18607f25acb" returned: 0 in 0.706s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:24 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-9ff1baff-2456-46d4-9089-a18607f25acb" released by "delete_volume" :: held 1.638s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:24 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Created reservations ['f020559c-fa91-43b0-a9d9-7dc781068cb1', 'a66356b1-6aa6-4039-8621-17a3c16fcede', 'efc4d623-46d1-4cd8-8cdb-1bc957b33e83', 'ccc5f60c-d6a3-4829-bdcc-4eeab7d1ff1e'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:24 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:24 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:24:24 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:24 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b" returned: 0 in 0.645s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:24 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:24 devstack sudo[106257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.info
Jul 09 09:24:24 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:25 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.678s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:24:25 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Deleted volume successfully.
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-88970b0c-cd4f-453c-aaf0-cf6017ef3a26 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-9ff1baff-2456-46d4-9089-a18607f25acb-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (e90db5c1-e1f7-41f5-b2db-a59cbb48e112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98df987-4421-4d54-a34b-aef2034ccbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98df987-4421-4d54-a34b-aef2034ccbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-282137677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bd2223-7778-4a75-915f-5f537b3c8e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:25Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6743ce12-9df0-49e8-8be2-651b53f3c3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6743ce12-9df0-49e8-8be2-651b53f3c3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd10a44-a583-4068-8ca0-9e4e3c995cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd10a44-a583-4068-8ca0-9e4e3c995cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05bd2223-7778-4a75-915f-5f537b3c8e9c', 'volume_name': 'volume-05bd2223-7778-4a75-915f-5f537b3c8e9c', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628ee790-e4dc-47f8-b484-720a1ceeb865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628ee790-e4dc-47f8-b484-720a1ceeb865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:25 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c029b77-2fd0-483d-ad8d-66f50c915814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:25 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Volume 05bd2223-7778-4a75-915f-5f537b3c8e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05bd2223-7778-4a75-915f-5f537b3c8e9c', 'volume_size': 1}
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.info" returned: 0 in 0.692s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:25 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.info is being set with open permissions: ugo+rw
Jul 09 09:24:25 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:25 devstack sudo[106261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.info
Jul 09 09:24:25 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:26 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.info" returned: 0 in 0.644s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.621s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.666s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-282137677',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bd2223-7778-4a75-915f-5f537b3c8e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:25Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Creating volume 05bd2223-7778-4a75-915f-5f537b3c8e9c {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:24:26 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:26 devstack sudo[106264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c 1073741824
Jul 09 09:24:26 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:26 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a07e7c43-490c-4e01-9fb1-655a33c592f9 tempest-ProjectReaderTests-1932699243 None] Create snapshot completed successfully
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-e085a88f-3e8c-4bb1-8026-8b9e9e977e8b-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Lock "cinder-e085a88f-3e8c-4bb1-8026-8b9e9e977e8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-e63a1441-cd44-43a7-9ac4-f4f4be657da2" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-e63a1441-cd44-43a7-9ac4-f4f4be657da2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-e085a88f-3e8c-4bb1-8026-8b9e9e977e8b" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-e085a88f-3e8c-4bb1-8026-8b9e9e977e8b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Deleting offline snapshot e085a88f-3e8c-4bb1-8026-8b9e9e977e8b of volume e63a1441-cd44-43a7-9ac4-f4f4be657da2 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] snapshot_file for this snap is: volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97f137f-86dd-474d-b49f-fc8dd2e4f579]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:26 devstack sudo[106269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b
Jul 09 09:24:26 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:26 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c 1073741824" returned: 0 in 0.874s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:26 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:26 devstack sudo[106271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c
Jul 09 09:24:26 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:27 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b" returned: 0 in 0.768s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:24:27 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eefd9a4-63b6-4823-8f87-3c21812dc77f]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:27 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c" returned: 0 in 0.646s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:27 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:24:27 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c029b77-2fd0-483d-ad8d-66f50c915814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05bd2223-7778-4a75-915f-5f537b3c8e9c', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0400cf-810d-40eb-966c-e8f7fc230211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:27 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Volume volume-05bd2223-7778-4a75-915f-5f537b3c8e9c (05bd2223-7778-4a75-915f-5f537b3c8e9c): created successfully
Jul 09 09:24:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0400cf-810d-40eb-966c-e8f7fc230211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:27 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (e90db5c1-e1f7-41f5-b2db-a59cbb48e112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:27 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-a35e1115-9ec5-4bf8-9ce8-a11bf66adcde tempest-ProjectMemberTests-1928387478 None] Created volume successfully.
Jul 09 09:24:27 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2
Jul 09 09:24:27 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:28 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2" returned: 0 in 0.771s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:28 devstack sudo[106318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b
Jul 09 09:24:28 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:28 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] Creating offline snapshot 2a012d88-90fe-4f56-8906-926e712e6fb0 of volume 05bd2223-7778-4a75-915f-5f537b3c8e9c {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:24:28 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a14b21-8483-478f-a236-ae74d019c71b]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:28 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:28 devstack sudo[106320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c
Jul 09 09:24:28 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:29 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b" returned: 0 in 0.750s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:29 devstack sudo[106325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b
Jul 09 09:24:29 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:29 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c" returned: 0 in 0.771s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:29 devstack sudo[106330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0 1G
Jul 09 09:24:29 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:29 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:29 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2.e085a88f-3e8c-4bb1-8026-8b9e9e977e8b" returned: 0 in 0.621s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-e085a88f-3e8c-4bb1-8026-8b9e9e977e8b" released by "_delete_snapshot" :: held 3.033s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-e63a1441-cd44-43a7-9ac4-f4f4be657da2" released by "delete_snapshot" :: held 3.066s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:29 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Created reservations ['afb153c2-0006-4c51-a5d2-2ddd9a174f8b', '1019998a-99a1-4f0e-8a6c-fcaf03f82d0b', '1daebec8-af35-4993-aa4c-ce5168f96cfd', '9e0adb47-a090-4a67-843b-f29c0c529fb2'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:29 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Delete snapshot completed successfully.
Jul 09 09:24:29 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-3e2947d1-c0ce-4572-b6c0-70945f6fc4ee tempest-ProjectReaderTests-1932699243 None] Lock "cinder-e085a88f-3e8c-4bb1-8026-8b9e9e977e8b-delete_snapshot" released by "delete_snapshot" :: held 3.222s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:30 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0 1G" returned: 0 in 0.802s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05bd2223-7778-4a75-915f-5f537b3c8e9c -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:30 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05bd2223-7778-4a75-915f-5f537b3c8e9c -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0
Jul 09 09:24:30 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:30 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05bd2223-7778-4a75-915f-5f537b3c8e9c -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0" returned: 0 in 0.701s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:30 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0 is being set with open permissions: ugo+rw
Jul 09 09:24:30 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:30 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-e63a1441-cd44-43a7-9ac4-f4f4be657da2-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:30 devstack sudo[106342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0
Jul 09 09:24:30 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:30 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-e63a1441-cd44-43a7-9ac4-f4f4be657da2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:30 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-e63a1441-cd44-43a7-9ac4-f4f4be657da2" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:30 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-e63a1441-cd44-43a7-9ac4-f4f4be657da2" acquired by "delete_volume" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:31 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d449ff55-ed64-45a4-a70e-e0f77bf530b2]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:31 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2
Jul 09 09:24:31 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:31 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0" returned: 0 in 0.638s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:31 devstack sudo[106347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.info
Jul 09 09:24:31 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:31 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2" returned: 0 in 0.769s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:31 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:31 devstack sudo[106352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2
Jul 09 09:24:31 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:32 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.info" returned: 0 in 0.624s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:32 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.info is being set with open permissions: ugo+rw
Jul 09 09:24:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:32 devstack sudo[106355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.info
Jul 09 09:24:32 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:32 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-e63a1441-cd44-43a7-9ac4-f4f4be657da2" returned: 0 in 0.659s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:32 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-e63a1441-cd44-43a7-9ac4-f4f4be657da2" released by "delete_volume" :: held 1.490s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:32 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Created reservations ['f2d0fc72-ddb3-4b89-8d3c-94e4e98a5b51', '00b5de00-e3a0-47ac-bbfe-cee3e7559fda', '7f51eaf2-970e-46ab-9c9c-4a72f1916e65', '95fb29a3-243c-4a6a-b350-93ecfcf0d1ce'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:32 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:32 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:24:32 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:32 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.info" returned: 0 in 0.655s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:32 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.283s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:32 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7e149ed4-bd37-498a-9d6e-b52ee09cce89 tempest-ProjectMemberTests-1928387478 None] Create snapshot completed successfully
Jul 09 09:24:33 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.668s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:24:33 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Deleted volume successfully.
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-42a0bfdf-49b1-451f-a67b-9b0e3a3672f3 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-e63a1441-cd44-43a7-9ac4-f4f4be657da2-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Flow 'volume_create_manager' (e5560813-4db9-4fea-8139-82ca6ddadf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f9c0ef-a806-463f-a947-2cdeda965212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f9c0ef-a806-463f-a947-2cdeda965212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1326042279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bbd597-7143-4be4-ba10-47a0185e62a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6f656845904aa9b49ee5780aa968f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:34Z,use_quota=True,user_id='6d65a947fd8749069630184a47b0df8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca3b2375-4331-4690-a2f8-7e68c146925f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca3b2375-4331-4690-a2f8-7e68c146925f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d630c8e-5be0-4423-b59b-64810c4dc6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d630c8e-5be0-4423-b59b-64810c4dc6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42bbd597-7143-4be4-ba10-47a0185e62a2', 'volume_name': 'volume-42bbd597-7143-4be4-ba10-47a0185e62a2', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5490f4-f0cf-4b2f-aaec-328c678f1c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5490f4-f0cf-4b2f-aaec-328c678f1c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1efd8898-31b1-49f4-af67-991f86af5116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:33 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Volume 42bbd597-7143-4be4-ba10-47a0185e62a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42bbd597-7143-4be4-ba10-47a0185e62a2', 'volume_size': 1}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1326042279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bbd597-7143-4be4-ba10-47a0185e62a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6f656845904aa9b49ee5780aa968f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:34Z,use_quota=True,user_id='6d65a947fd8749069630184a47b0df8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Creating volume 42bbd597-7143-4be4-ba10-47a0185e62a2 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:24:33 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:33 devstack sudo[106362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2 1073741824
Jul 09 09:24:33 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-2a012d88-90fe-4f56-8906-926e712e6fb0-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Lock "cinder-2a012d88-90fe-4f56-8906-926e712e6fb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-05bd2223-7778-4a75-915f-5f537b3c8e9c" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-05bd2223-7778-4a75-915f-5f537b3c8e9c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-2a012d88-90fe-4f56-8906-926e712e6fb0" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-2a012d88-90fe-4f56-8906-926e712e6fb0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Deleting offline snapshot 2a012d88-90fe-4f56-8906-926e712e6fb0 of volume 05bd2223-7778-4a75-915f-5f537b3c8e9c {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] snapshot_file for this snap is: volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[deac8ab0-b92d-440d-8c01-f76b5d3ea63e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:33 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:33 devstack sudo[106364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0
Jul 09 09:24:33 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:34 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2 1073741824" returned: 0 in 0.852s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:34 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2
Jul 09 09:24:34 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:34 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0" returned: 0 in 0.782s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:34 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05bd2223-7778-4a75-915f-5f537b3c8e9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:24:34 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c92434-35fe-44bf-80ac-d41fd070cef9]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:34 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:34 devstack sudo[106381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c
Jul 09 09:24:34 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:35 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2" returned: 0 in 0.684s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:24:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1efd8898-31b1-49f4-af67-991f86af5116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42bbd597-7143-4be4-ba10-47a0185e62a2', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4273382f-45a4-449b-abee-d53960ee580f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:35 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Volume volume-42bbd597-7143-4be4-ba10-47a0185e62a2 (42bbd597-7143-4be4-ba10-47a0185e62a2): created successfully
Jul 09 09:24:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4273382f-45a4-449b-abee-d53960ee580f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:35 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Flow 'volume_create_manager' (e5560813-4db9-4fea-8139-82ca6ddadf8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:35 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-95ae45a0-53c5-4120-a5d2-69fbda624f71 tempest-ProjectReaderTests-1932699243 None] Created volume successfully.
Jul 09 09:24:35 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c" returned: 0 in 0.768s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:35 devstack sudo[106387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0
Jul 09 09:24:35 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:35 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] Creating offline snapshot a75c07de-97d4-4424-8756-e9a6fcaddb88 of volume 42bbd597-7143-4be4-ba10-47a0185e62a2 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:24:35 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f55d28e-52b7-483d-bac6-e999f554aa0d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:35 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:35 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2
Jul 09 09:24:35 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:36 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0" returned: 0 in 0.731s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:36 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0
Jul 09 09:24:36 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:36 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2" returned: 0 in 0.799s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:36 devstack sudo[106399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88 1G
Jul 09 09:24:36 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:36 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:36 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c.2a012d88-90fe-4f56-8906-926e712e6fb0" returned: 0 in 0.650s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-2a012d88-90fe-4f56-8906-926e712e6fb0" released by "_delete_snapshot" :: held 3.056s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:36 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-05bd2223-7778-4a75-915f-5f537b3c8e9c" released by "delete_snapshot" :: held 3.079s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:36 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Created reservations ['342f49e0-a6d8-41e5-bd01-ea1d7ae62b07', '0cdb6bd7-74ef-4e80-8288-8c8b0ca7a37c', 'b45f29ab-ddda-4888-bedd-a1aa91b84c5a', '4686b6b4-cfd3-42fa-8e4d-ba4af9628d2c'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:36 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Delete snapshot completed successfully.
Jul 09 09:24:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-81247e90-93b9-4d8a-832d-a6a7cd5f2d3a tempest-ProjectMemberTests-1928387478 None] Lock "cinder-2a012d88-90fe-4f56-8906-926e712e6fb0-delete_snapshot" released by "delete_snapshot" :: held 3.219s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:37 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88 1G" returned: 0 in 0.791s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:37 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42bbd597-7143-4be4-ba10-47a0185e62a2 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:37 devstack sudo[106406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42bbd597-7143-4be4-ba10-47a0185e62a2 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88
Jul 09 09:24:37 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:37 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-05bd2223-7778-4a75-915f-5f537b3c8e9c-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Lock "cinder-05bd2223-7778-4a75-915f-5f537b3c8e9c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:38 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=144,cinder:INSERT=50,cinder:UPDATE=196,cinder:DELETE=14 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:24:38 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:UPDATE=176,cinder:DELETE=17,cinder:SELECT=131,cinder:INSERT=48 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:24:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-05bd2223-7778-4a75-915f-5f537b3c8e9c" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:38 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-05bd2223-7778-4a75-915f-5f537b3c8e9c" acquired by "delete_volume" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:38 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[36226681-1a1a-48c7-9e16-c7a02af1c5da]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:38 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42bbd597-7143-4be4-ba10-47a0185e62a2 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88" returned: 0 in 0.735s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:38 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88 is being set with open permissions: ugo+rw
Jul 09 09:24:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:38 devstack sudo[106412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c
Jul 09 09:24:38 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:38 devstack sudo[106413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88
Jul 09 09:24:38 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:38 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88" returned: 0 in 0.636s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:38 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:38 devstack sudo[106420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.info
Jul 09 09:24:38 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c" returned: 0 in 0.780s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:38 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:38 devstack sudo[106422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c
Jul 09 09:24:38 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:39 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.info" returned: 0 in 0.669s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:39 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.info is being set with open permissions: ugo+rw
Jul 09 09:24:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:39 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-05bd2223-7778-4a75-915f-5f537b3c8e9c" returned: 0 in 0.661s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:39 devstack sudo[106427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.info
Jul 09 09:24:39 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:39 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-05bd2223-7778-4a75-915f-5f537b3c8e9c" released by "delete_volume" :: held 1.505s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:39 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Created reservations ['e7b91b22-ecea-4fce-ae92-b435a8bc5105', 'd3a7d0a6-3bae-4a5a-bc29-b0857d749d33', '4f1b3b57-8243-4d00-b9e2-1ea62621768a', 'fd33d2f8-0c66-4df4-8ff9-51fbedf6989a'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:39 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:39 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:39 devstack sudo[106429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:24:39 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:40 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.info" returned: 0 in 0.675s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.400s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:40 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-e1927d4d-b678-4460-a8ff-5644a3f6ac5f tempest-ProjectReaderTests-1932699243 None] Create snapshot completed successfully
Jul 09 09:24:40 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.674s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:24:40 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Deleted volume successfully.
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-7b423f70-41d9-4410-9adc-5b239e382d8f tempest-ProjectMemberTests-1928387478 None] Lock "cinder-05bd2223-7778-4a75-915f-5f537b3c8e9c-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (6d60ccb0-4ea9-46d6-b03f-582442bebc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0292511d-5fcf-45bb-8843-d0cb95275efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0292511d-5fcf-45bb-8843-d0cb95275efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-275505681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d08d84d-10d5-48e0-884e-277d2705a84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:41Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9ae95d-bfae-42a3-9dc7-3dc612761efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9ae95d-bfae-42a3-9dc7-3dc612761efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e54af52-49b1-4d2f-ab0f-a2077348bca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e54af52-49b1-4d2f-ab0f-a2077348bca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d08d84d-10d5-48e0-884e-277d2705a84a', 'volume_name': 'volume-6d08d84d-10d5-48e0-884e-277d2705a84a', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58ea3f0-fe99-44c7-bd66-e87ed330c7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58ea3f0-fe99-44c7-bd66-e87ed330c7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2950cc2d-2860-4938-8b90-93e167146501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:40 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Volume 6d08d84d-10d5-48e0-884e-277d2705a84a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d08d84d-10d5-48e0-884e-277d2705a84a', 'volume_size': 1}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-275505681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d08d84d-10d5-48e0-884e-277d2705a84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:41Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Creating volume 6d08d84d-10d5-48e0-884e-277d2705a84a {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:24:40 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:24:40 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:40 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a 1073741824
Jul 09 09:24:40 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-a75c07de-97d4-4424-8756-e9a6fcaddb88-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-a75c07de-97d4-4424-8756-e9a6fcaddb88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-42bbd597-7143-4be4-ba10-47a0185e62a2" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-42bbd597-7143-4be4-ba10-47a0185e62a2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-a75c07de-97d4-4424-8756-e9a6fcaddb88" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:41 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-a75c07de-97d4-4424-8756-e9a6fcaddb88" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Deleting offline snapshot a75c07de-97d4-4424-8756-e9a6fcaddb88 of volume 42bbd597-7143-4be4-ba10-47a0185e62a2 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:24:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] snapshot_file for this snap is: volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:24:41 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3fb0e0-6b57-4a1f-9859-4385811f5d15]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:41 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88
Jul 09 09:24:41 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:41 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a 1073741824" returned: 0 in 0.840s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:41 devstack sudo[106440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a
Jul 09 09:24:41 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:41 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:41 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88" returned: 0 in 0.803s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:41 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42bbd597-7143-4be4-ba10-47a0185e62a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e946f769-4556-4ff3-876e-c0bf9569032e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:42 devstack sudo[106445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2
Jul 09 09:24:42 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:42 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a" returned: 0 in 0.674s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2950cc2d-2860-4938-8b90-93e167146501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d08d84d-10d5-48e0-884e-277d2705a84a', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57196f1-af51-40ba-b5cc-1553399a9a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:42 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Volume volume-6d08d84d-10d5-48e0-884e-277d2705a84a (6d08d84d-10d5-48e0-884e-277d2705a84a): created successfully
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57196f1-af51-40ba-b5cc-1553399a9a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (6d60ccb0-4ea9-46d6-b03f-582442bebc68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:42 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-1f0fcb17-4ed7-4285-a1bc-a8e9f1dff8d4 tempest-ProjectMemberTests-1928387478 None] Created volume successfully.
Jul 09 09:24:42 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2" returned: 0 in 0.754s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:42 devstack sudo[106451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88
Jul 09 09:24:42 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] Creating offline snapshot a0652ff8-6866-48d3-83a8-c2b5b87a94d8 of volume 6d08d84d-10d5-48e0-884e-277d2705a84a {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0aa07a-4f31-4021-af15-1bd97f91e794]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:42 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:43 devstack sudo[106453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a
Jul 09 09:24:43 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:43 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88" returned: 0 in 0.774s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:43 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88
Jul 09 09:24:43 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:43 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a" returned: 0 in 0.779s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:43 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:43 devstack sudo[106463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8 1G
Jul 09 09:24:43 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:44 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2.a75c07de-97d4-4424-8756-e9a6fcaddb88" returned: 0 in 0.661s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-a75c07de-97d4-4424-8756-e9a6fcaddb88" released by "_delete_snapshot" :: held 3.092s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-42bbd597-7143-4be4-ba10-47a0185e62a2" released by "delete_snapshot" :: held 3.117s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:44 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Created reservations ['ec5228f9-2a65-4821-bf3d-dcdfd6f6e758', 'e5d17863-efb6-4ca6-a5ef-af6132af83f0', '5509db8e-7567-42e2-aa4f-04d69c1b4904', 'f61ed7d0-946f-4520-a445-058af112e315'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:44 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Delete snapshot completed successfully.
Jul 09 09:24:44 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5abc6b3b-f503-40f5-bab8-17aabc583154 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-a75c07de-97d4-4424-8756-e9a6fcaddb88-delete_snapshot" released by "delete_snapshot" :: held 3.258s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:44 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8 1G" returned: 0 in 0.807s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:44 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d08d84d-10d5-48e0-884e-277d2705a84a -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:44 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d08d84d-10d5-48e0-884e-277d2705a84a -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8
Jul 09 09:24:44 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:45 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d08d84d-10d5-48e0-884e-277d2705a84a -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8" returned: 0 in 0.708s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:45 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8 is being set with open permissions: ugo+rw
Jul 09 09:24:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-42bbd597-7143-4be4-ba10-47a0185e62a2-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:45 devstack sudo[106475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8
Jul 09 09:24:45 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Lock "cinder-42bbd597-7143-4be4-ba10-47a0185e62a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-42bbd597-7143-4be4-ba10-47a0185e62a2" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:45 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-42bbd597-7143-4be4-ba10-47a0185e62a2" acquired by "delete_volume" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:45 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f7028b-3bf4-44c4-8b51-23f4f5751636]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:45 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2
Jul 09 09:24:45 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:45 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8" returned: 0 in 0.668s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:45 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:46 devstack sudo[106480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.info
Jul 09 09:24:46 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:46 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2" returned: 0 in 0.783s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:46 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2
Jul 09 09:24:46 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:46 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.info" returned: 0 in 0.672s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:46 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.info is being set with open permissions: ugo+rw
Jul 09 09:24:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:46 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.info
Jul 09 09:24:46 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:46 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-42bbd597-7143-4be4-ba10-47a0185e62a2" returned: 0 in 0.643s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:46 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-42bbd597-7143-4be4-ba10-47a0185e62a2" released by "delete_volume" :: held 1.481s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:46 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Created reservations ['e666e5be-1b10-4bd4-8f14-42698675107e', 'a70b2735-295e-468d-9599-813967b66d7f', '493067c8-ce58-48d2-8ed8-cb9047c8a62e', '5defb531-8f30-40a4-894f-0087242516c8'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:46 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:46 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:47 devstack sudo[106491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:24:47 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:47 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.info" returned: 0 in 0.662s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.377s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:47 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-d182d252-85b6-4a53-b944-34d0d010354e tempest-ProjectMemberTests-1928387478 None] Create snapshot completed successfully
Jul 09 09:24:47 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:47 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.665s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:47 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:24:47 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Deleted volume successfully.
Jul 09 09:24:47 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-8435377f-b1b0-44e5-9c13-a885ad2fe66a tempest-ProjectReaderTests-1932699243 None] Lock "cinder-42bbd597-7143-4be4-ba10-47a0185e62a2-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:47 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:24:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Flow 'volume_create_manager' (b4123d0e-2e11-433b-9023-28dff164b475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05e4209-5ca8-4000-a822-a99fd5893e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05e4209-5ca8-4000-a822-a99fd5893e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-870815558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6f656845904aa9b49ee5780aa968f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:48Z,use_quota=True,user_id='6d65a947fd8749069630184a47b0df8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04df87aa-2b2d-409b-9e0d-7d5be510ca9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:47 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04df87aa-2b2d-409b-9e0d-7d5be510ca9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4289de1d-2a7e-4fa9-886f-5bd5dacec123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4289de1d-2a7e-4fa9-886f-5bd5dacec123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e', 'volume_name': 'volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad0e832-df82-40b3-9562-d0f6072da26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad0e832-df82-40b3-9562-d0f6072da26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc005ffd-085b-4b7b-9b7e-85d73035b801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:48 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Volume bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e', 'volume_size': 1}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-870815558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6f656845904aa9b49ee5780aa968f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:48Z,use_quota=True,user_id='6d65a947fd8749069630184a47b0df8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Creating volume bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:24:48 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:48 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e 1073741824
Jul 09 09:24:48 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-a0652ff8-6866-48d3-83a8-c2b5b87a94d8-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-a0652ff8-6866-48d3-83a8-c2b5b87a94d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-6d08d84d-10d5-48e0-884e-277d2705a84a" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-6d08d84d-10d5-48e0-884e-277d2705a84a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-a0652ff8-6866-48d3-83a8-c2b5b87a94d8" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-a0652ff8-6866-48d3-83a8-c2b5b87a94d8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Deleting offline snapshot a0652ff8-6866-48d3-83a8-c2b5b87a94d8 of volume 6d08d84d-10d5-48e0-884e-277d2705a84a {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] snapshot_file for this snap is: volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9bfa1a-33e1-4f5d-b89e-a8badd250ee4]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:48 devstack sudo[106497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8
Jul 09 09:24:48 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:48 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e 1073741824" returned: 0 in 0.851s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:48 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:48 devstack sudo[106504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e
Jul 09 09:24:48 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:49 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8" returned: 0 in 0.783s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d08d84d-10d5-48e0-884e-277d2705a84a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:24:49 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5178ec23-c953-42b7-9fb0-b1c849753e35]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:49 devstack sudo[106507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a
Jul 09 09:24:49 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:49 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e" returned: 0 in 0.630s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:49 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:24:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc005ffd-085b-4b7b-9b7e-85d73035b801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853eed5b-cc23-4367-b589-f4c846615ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:49 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Volume volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e (bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e): created successfully
Jul 09 09:24:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853eed5b-cc23-4367-b589-f4c846615ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:49 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Flow 'volume_create_manager' (b4123d0e-2e11-433b-9023-28dff164b475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:49 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-ffe81106-bc1c-47eb-9d4b-5dd6d55a356a tempest-ProjectReaderTests-1932699243 None] Created volume successfully.
Jul 09 09:24:49 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a" returned: 0 in 0.773s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:49 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:49 devstack sudo[106514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8
Jul 09 09:24:49 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:50 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] Creating offline snapshot 64c616db-bde6-4ef9-89f8-74f917c325fc of volume bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:24:50 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf7097a-71aa-40ed-8799-72c41b79870e]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:50 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e
Jul 09 09:24:50 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:50 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8" returned: 0 in 0.715s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:50 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:50 devstack sudo[106521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8
Jul 09 09:24:50 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:51 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e" returned: 0 in 0.768s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:51 devstack sudo[106526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc 1G
Jul 09 09:24:51 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:51 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a.a0652ff8-6866-48d3-83a8-c2b5b87a94d8" returned: 0 in 0.634s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-a0652ff8-6866-48d3-83a8-c2b5b87a94d8" released by "_delete_snapshot" :: held 2.999s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-6d08d84d-10d5-48e0-884e-277d2705a84a" released by "delete_snapshot" :: held 3.021s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:51 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Created reservations ['638d661c-cb77-44c9-b8ab-e9139061e453', '03f19c59-82e2-4cb9-a7e2-ed9bcfbb5b50', '8e47d57c-35b2-4025-95b4-ab89ab09812c', '28b650a1-0461-42d2-a9e8-55f7056dee99'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:51 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Delete snapshot completed successfully.
Jul 09 09:24:51 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-43f62214-5a69-49b9-bae5-39095cbd5278 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-a0652ff8-6866-48d3-83a8-c2b5b87a94d8-delete_snapshot" released by "delete_snapshot" :: held 3.163s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:51 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc 1G" returned: 0 in 0.793s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:51 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:51 devstack sudo[106532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc
Jul 09 09:24:51 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:52 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-6d08d84d-10d5-48e0-884e-277d2705a84a-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:52 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-6d08d84d-10d5-48e0-884e-277d2705a84a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:52 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:52 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-6d08d84d-10d5-48e0-884e-277d2705a84a" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc" returned: 0 in 0.692s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:52 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc is being set with open permissions: ugo+rw
Jul 09 09:24:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:52 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-6d08d84d-10d5-48e0-884e-277d2705a84a" acquired by "delete_volume" :: waited 0.029s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:52 devstack sudo[106537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc
Jul 09 09:24:52 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:52 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef61ea25-5ff4-4236-a0b9-c5abc24b3763]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:52 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:52 devstack sudo[106539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a
Jul 09 09:24:52 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:53 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc" returned: 0 in 0.624s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:53 devstack sudo[106542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.info
Jul 09 09:24:53 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:53 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a" returned: 0 in 0.758s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:53 devstack sudo[106547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a
Jul 09 09:24:53 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:53 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.info" returned: 0 in 0.667s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:53 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.info is being set with open permissions: ugo+rw
Jul 09 09:24:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:53 devstack sudo[106550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.info
Jul 09 09:24:53 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:53 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:53 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-6d08d84d-10d5-48e0-884e-277d2705a84a" returned: 0 in 0.663s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-6d08d84d-10d5-48e0-884e-277d2705a84a" released by "delete_volume" :: held 1.483s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Created reservations ['6f415e32-2c57-4078-b0de-a212a773e3a5', '2d76f42d-b5c0-4192-a601-e544749de8e2', '1a57a9d9-6439-426b-814b-081a6d6ea0aa', 'f3ca2aa0-5a2c-4219-9014-205b3cc20ea8'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:54 devstack sudo[106553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:24:54 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:54 devstack sudo[106554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:24:54 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:54 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.info" returned: 0 in 0.676s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.307s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:54 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-30b9d17f-fe65-40b0-923c-259f9aebdc15 tempest-ProjectReaderTests-1932699243 None] Create snapshot completed successfully
Jul 09 09:24:54 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.690s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:54 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.678s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:24:54 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Deleted volume successfully.
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-55cfbe01-91df-4234-8603-230762aad218 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-6d08d84d-10d5-48e0-884e-277d2705a84a-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG oslo_service.periodic_task [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] Running periodic task VolumeManager._thread_info {{(pid=87009) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread count: 29 {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 09 09:24:54 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-eef2db91-b1fa-4253-845c-456ed49a9344 None None] thread info: [<_MainThread(MainThread, started 138287774765184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138287664969728)>, <Thread(Thread-3 (stat_writer), started daemon 138287662614912)>, <Thread(Rabbit-heartbeat, started daemon 138287663387456)>, <Thread(Thread-5 (_runner), started daemon 138287663509952)>, <Thread(Thread-7 (_runner), started daemon 138287661454144)>, <Thread(fd_logger, started daemon 138287659819520)>, <Thread(privsep_reader, started daemon 138287659512384)>, <Thread(tpool_thread_0, started daemon 138287650465472)>, <Thread(tpool_thread_1, started daemon 138287642072768)>, <Thread(tpool_thread_2, started daemon 138287633663680)>, <Thread(tpool_thread_3, started daemon 138287625254592)>, <Thread(tpool_thread_4, started daemon 138287616845504)>, <Thread(tpool_thread_5, started daemon 138287608436416)>, <Thread(tpool_thread_6, started daemon 138287600027328)>, <Thread(tpool_thread_7, started daemon 138287591618240)>, <Thread(tpool_thread_8, started daemon 138287583209152)>, <Thread(tpool_thread_9, started daemon 138287574800064)>, <Thread(tpool_thread_10, started daemon 138287566390976)>, <Thread(tpool_thread_11, started daemon 138287557981888)>, <Thread(tpool_thread_12, started daemon 138287549572800)>, <Thread(tpool_thread_13, started daemon 138287541163712)>, <Thread(tpool_thread_14, started daemon 138287532754624)>, <Thread(tpool_thread_15, started daemon 138287524345536)>, <Thread(tpool_thread_16, started daemon 138287515936448)>, <Thread(tpool_thread_17, started daemon 138287507527360)>, <Thread(tpool_thread_18, started daemon 138287499118272)>, <Thread(tpool_thread_19, started daemon 138287490709184)>, <Thread(Rabbit-heartbeat, started daemon 138287481103552)>] {{(pid=87009) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87009) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (dfce5b4d-b999-48ee-b6ef-e4cd601c560c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b0d6bf-d1cb-44ad-9f21-b587dcabf868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b0d6bf-d1cb-44ad-9f21-b587dcabf868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2015018344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de620f0-0475-4a96-a43b-1e60f41f00c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:55Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb9d951-c37d-49c6-b67d-a3018f047e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb9d951-c37d-49c6-b67d-a3018f047e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bef1ce5-a456-49f3-a1da-cf8222a2b77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bef1ce5-a456-49f3-a1da-cf8222a2b77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de620f0-0475-4a96-a43b-1e60f41f00c7', 'volume_name': 'volume-7de620f0-0475-4a96-a43b-1e60f41f00c7', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56833a17-81dc-4233-9e83-15aad67514f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56833a17-81dc-4233-9e83-15aad67514f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4530e47-4c36-4228-ada9-ee02af2b3593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:55 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Volume 7de620f0-0475-4a96-a43b-1e60f41f00c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de620f0-0475-4a96-a43b-1e60f41f00c7', 'volume_size': 1}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7dc59b125190>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-09T07:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2015018344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de620f0-0475-4a96-a43b-1e60f41f00c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c852f9d219474d99943d1142e5df49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:24:55Z,use_quota=True,user_id='6be1dc14461f4aa1a76f64d7ffc1b222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ae2b47c-1ff9-4a16-8af1-9eff48423587),volume_type_id=9ae2b47c-1ff9-4a16-8af1-9eff48423587)}" {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Creating volume 7de620f0-0475-4a96-a43b-1e60f41f00c7 {{(pid=87009) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Selected osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d as target Quobyte volume. {{(pid=87009) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 09 09:24:55 devstack cinder-volume[87009]: INFO cinder.volume.drivers.remotefs [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] casted to osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7 1073741824 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:55 devstack sudo[106560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7 1073741824
Jul 09 09:24:55 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-64c616db-bde6-4ef9-89f8-74f917c325fc-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-64c616db-bde6-4ef9-89f8-74f917c325fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-64c616db-bde6-4ef9-89f8-74f917c325fc" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-64c616db-bde6-4ef9-89f8-74f917c325fc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Deleting offline snapshot 64c616db-bde6-4ef9-89f8-74f917c325fc of volume bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] snapshot_file for this snap is: volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7cb28d-7248-47e2-a417-95e09ec77602]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:55 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:55 devstack sudo[106562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc
Jul 09 09:24:55 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:56 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7 1073741824" returned: 0 in 0.818s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:56 devstack sudo[106567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7
Jul 09 09:24:56 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:56 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc" returned: 0 in 0.771s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:24:56 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c88f9df-dc9a-4dbd-aaa1-957892545e32]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:56 devstack sudo[106572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e
Jul 09 09:24:56 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:56 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7" returned: 0 in 0.666s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:56 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'} {{(pid=87009) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 09 09:24:56 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:24:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4530e47-4c36-4228-ada9-ee02af2b3593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de620f0-0475-4a96-a43b-1e60f41f00c7', 'volume_size': 1}' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d3d0a6-8464-4d53-89e0-f9e5e4192e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 09 09:24:56 devstack cinder-volume[87009]: INFO cinder.volume.flows.manager.create_volume [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Volume volume-7de620f0-0475-4a96-a43b-1e60f41f00c7 (7de620f0-0475-4a96-a43b-1e60f41f00c7): created successfully
Jul 09 09:24:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d3d0a6-8464-4d53-89e0-f9e5e4192e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87009) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 09 09:24:56 devstack cinder-volume[87009]: DEBUG cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Flow 'volume_create_manager' (dfce5b4d-b999-48ee-b6ef-e4cd601c560c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87009) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 09 09:24:56 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5bc4a52d-6331-4e19-bee9-0a8297b57fbb tempest-ProjectMemberTests-1928387478 None] Created volume successfully.
Jul 09 09:24:57 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e" returned: 0 in 0.737s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:57 devstack sudo[106578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc
Jul 09 09:24:57 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:24:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:24:57 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] Creating offline snapshot 675cefaa-50c0-4822-8a71-76ebfc0c46ea of volume 7de620f0-0475-4a96-a43b-1e60f41f00c7 {{(pid=87009) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 09 09:24:57 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[370b5418-f4c5-46e5-a7e4-a0d4e08b5d3a]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:57 devstack sudo[106580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7
Jul 09 09:24:57 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:57 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc" returned: 0 in 0.783s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:57 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:57 devstack sudo[106585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc
Jul 09 09:24:57 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:58 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7" returned: 0 in 0.741s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea 1G {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:58 devstack sudo[106590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea 1G
Jul 09 09:24:58 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:58 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e.64c616db-bde6-4ef9-89f8-74f917c325fc" returned: 0 in 0.671s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-64c616db-bde6-4ef9-89f8-74f917c325fc" released by "_delete_snapshot" :: held 3.042s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e" released by "delete_snapshot" :: held 3.071s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:58 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Created reservations ['48225d88-f683-4ccd-94c6-71476141a564', 'd295ad26-e3fd-4e12-8101-03d74bf9fced', '51ceb8bd-c680-45c1-90da-bd467e3c0f0b', '827a82c4-6ebf-447f-b0dd-a6d3b5cfc2f3'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:24:58 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Delete snapshot completed successfully.
Jul 09 09:24:58 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-25538233-f718-4fc0-94d2-4a36868a37a0 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-64c616db-bde6-4ef9-89f8-74f917c325fc-delete_snapshot" released by "delete_snapshot" :: held 3.217s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:24:58 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea 1G" returned: 0 in 0.782s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:58 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de620f0-0475-4a96-a43b-1e60f41f00c7 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:58 devstack sudo[106596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de620f0-0475-4a96-a43b-1e60f41f00c7 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea
Jul 09 09:24:58 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:59 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root
Jul 09 09:24:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de620f0-0475-4a96-a43b-1e60f41f00c7 -F qcow2 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea" returned: 0 in 0.666s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:24:59 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea is being set with open permissions: ugo+rw
Jul 09 09:24:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:59 devstack sudo[106602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea
Jul 09 09:24:59 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:24:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "cinder-quobyte-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:24:59 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e" acquired by "delete_volume" :: waited 0.020s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:24:59 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9729e35-b0b4-429c-8ced-d9e005accfee]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:24:59 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:24:59 devstack sudo[106604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e
Jul 09 09:24:59 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:25:00 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root
Jul 09 09:25:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea" returned: 0 in 0.705s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:25:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:25:00 devstack sudo[106608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.info
Jul 09 09:25:00 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:25:00 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root
Jul 09 09:25:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e" returned: 0 in 0.797s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:25:00 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:25:00 devstack sudo[106613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e
Jul 09 09:25:00 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:25:01 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root
Jul 09 09:25:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.info" returned: 0 in 0.671s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:25:01 devstack cinder-volume[87009]: WARNING cinder.volume.drivers.remotefs [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.info is being set with open permissions: ugo+rw
Jul 09 09:25:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.info {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:25:01 devstack sudo[106616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.info
Jul 09 09:25:01 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:25:01 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root
Jul 09 09:25:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e" returned: 0 in 0.683s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:25:01 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-quobyte-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e" released by "delete_volume" :: held 1.534s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:25:01 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Created reservations ['ebef7ede-efac-483d-ab1f-63da771b3835', 'f4a1ac90-01f4-45c2-acc0-9cf685952d35', 'aed52800-4eed-4d4a-ac79-4f9d406fdf09', 'd4fa0e25-09b9-4ecc-9f1b-8701005813c4'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:25:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:25:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:25:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:25:01 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:25:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:25:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:25:01 devstack sudo[106619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:25:01 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:25:01 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root
Jul 09 09:25:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.info" returned: 0 in 0.655s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:25:01 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.316s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:25:01 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-41050b15-c1fa-432d-b7de-02ea7fc800b7 tempest-ProjectMemberTests-1928387478 None] Create snapshot completed successfully
Jul 09 09:25:02 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root
Jul 09 09:25:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.702s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:25:02 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:25:02 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Deleted volume successfully.
Jul 09 09:25:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-c5c97495-07bc-45e0-b7e2-1c33a3a3e3e4 tempest-ProjectReaderTests-1932699243 None] Lock "cinder-bc6bd9ec-fed1-485f-8e9f-8d36ee7a1c6e-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:25:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-675cefaa-50c0-4822-8a71-76ebfc0c46ea-delete_snapshot" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:25:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-675cefaa-50c0-4822-8a71-76ebfc0c46ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:25:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-7de620f0-0475-4a96-a43b-1e60f41f00c7" by "delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:25:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-7de620f0-0475-4a96-a43b-1e60f41f00c7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:25:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-675cefaa-50c0-4822-8a71-76ebfc0c46ea" by "_delete_snapshot" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:25:02 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-675cefaa-50c0-4822-8a71-76ebfc0c46ea" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:25:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Deleting offline snapshot 675cefaa-50c0-4822-8a71-76ebfc0c46ea of volume 7de620f0-0475-4a96-a43b-1e60f41f00c7 {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 09 09:25:02 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] snapshot_file for this snap is: volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea {{(pid=87009) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 09 09:25:02 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cecfda-950f-4883-892f-14c6d4134148]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:25:02 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:25:02 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea
Jul 09 09:25:02 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:25:03 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Jul 09 09:25:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea" returned: 0 in 0.817s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:25:03 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.remotefs [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7de620f0-0475-4a96-a43b-1e60f41f00c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87009) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 09 09:25:03 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02fde19-b34e-4f26-a441-5013195426b2]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:25:03 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:25:03 devstack sudo[106962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7
Jul 09 09:25:03 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:25:04 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root
Jul 09 09:25:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7" returned: 0 in 0.771s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:25:04 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:25:04 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea
Jul 09 09:25:04 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:25:05 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Jul 09 09:25:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea" returned: 0 in 0.709s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:25:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:25:05 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea
Jul 09 09:25:05 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:25:05 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Jul 09 09:25:05 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7.675cefaa-50c0-4822-8a71-76ebfc0c46ea" returned: 0 in 0.646s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:25:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-675cefaa-50c0-4822-8a71-76ebfc0c46ea" released by "_delete_snapshot" :: held 3.050s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:25:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-7de620f0-0475-4a96-a43b-1e60f41f00c7" released by "delete_snapshot" :: held 3.076s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:25:05 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Created reservations ['0c53ecbc-238e-46fb-b779-f90c79e81566', '249e9748-faec-40fd-99fb-23d496f07b67', 'c34b6584-ae43-4157-95d4-faa761680f49', 'fc7f72ea-4da4-49ae-bd6b-c4033c27b09c'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:25:05 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Delete snapshot completed successfully.
Jul 09 09:25:05 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-b9e9cb7c-2d65-4b17-b391-e3027b159b30 tempest-ProjectMemberTests-1928387478 None] Lock "cinder-675cefaa-50c0-4822-8a71-76ebfc0c46ea-delete_snapshot" released by "delete_snapshot" :: held 3.215s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:25:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-7de620f0-0475-4a96-a43b-1e60f41f00c7-delete_volume" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:25:06 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Lock "cinder-7de620f0-0475-4a96-a43b-1e60f41f00c7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:25:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Acquiring lock "cinder-quobyte-7de620f0-0475-4a96-a43b-1e60f41f00c7" by "delete_volume" {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 09 09:25:07 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-7de620f0-0475-4a96-a43b-1e60f41f00c7" acquired by "delete_volume" :: waited 0.017s {{(pid=87009) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 09 09:25:07 devstack cinder-volume[87009]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6480064-28ce-40b9-bfc9-38e081b5a54d]: (4, 'qcow2') {{(pid=87966) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 09 09:25:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:25:07 devstack sudo[106976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7
Jul 09 09:25:07 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:25:07 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root
Jul 09 09:25:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7" returned: 0 in 0.764s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:25:07 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:25:07 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7
Jul 09 09:25:07 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:25:08 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Jul 09 09:25:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443/volume-7de620f0-0475-4a96-a43b-1e60f41f00c7" returned: 0 in 0.644s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:25:08 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Lock "cinder-quobyte-7de620f0-0475-4a96-a43b-1e60f41f00c7" released by "delete_volume" :: held 1.462s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:25:08 devstack cinder-volume[87009]: DEBUG cinder.quota [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Created reservations ['853c6584-8d9a-413a-a063-866bdf6225d0', 'b5c760a3-a65b-4f39-a75d-80b0af53329c', 'b21e6b55-a212-4aaa-9bf7-63e260cc6a36', '8b9d588a-1117-486d-b9de-b8f8d2612d04'] {{(pid=87009) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 09 09:25:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 09 09:25:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 09 09:25:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d': None} {{(pid=87009) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 09 09:25:08 devstack cinder-volume[87009]: DEBUG cinder.volume.drivers.quobyte [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bfeacc19-a1b6-47b4-afea-a889cafd060d'] {{(pid=87009) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 09 09:25:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.lockutils [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87009) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 09 09:25:08 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443 {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 09 09:25:08 devstack sudo[106984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443
Jul 09 09:25:08 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 09 09:25:09 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root
Jul 09 09:25:09 devstack cinder-volume[87009]: DEBUG oslo_concurrency.processutils [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/206b96376eed72b83f93eaf4f97e2443" returned: 0 in 0.657s {{(pid=87009) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 09 09:25:09 devstack cinder-volume[87009]: DEBUG cinder.manager [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Notifying Schedulers of capabilities ... {{(pid=87009) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 09 09:25:09 devstack cinder-volume[87009]: INFO cinder.volume.manager [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Deleted volume successfully.
Jul 09 09:25:09 devstack cinder-volume[87009]: DEBUG cinder.coordination [None req-5b5529aa-abcd-4ca6-8209-1f23903f3cdf tempest-ProjectMemberTests-1928387478 None] Lock "cinder-7de620f0-0475-4a96-a43b-1e60f41f00c7-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=87009) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 09 09:25:18 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=54,cinder:INSERT=21,cinder:UPDATE=81,cinder:DELETE=6 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 09 09:25:19 devstack cinder-volume[87009]: DEBUG dbcounter [-] [87009] Writing DB stats cinder:SELECT=61,cinder:UPDATE=71,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87009) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}